[ 525.027601] env[65570]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 525.027601] env[65570]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 526.048718] env[65660]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 526.048718] env[65660]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.613154] env[65660]: INFO neutron.common.config [-] Logging enabled! [ 527.613568] env[65660]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev40 [ 527.613702] env[65660]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65660) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 527.614024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 527.614120] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 527.614955] env[65660]: WARNING oslo_policy.policy [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.615187] env[65660]: WARNING oslo_policy.policy [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.616981] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] VMware NSXv3 Agent initialized successfully. [ 527.617231] env[65660]: DEBUG oslo_concurrency.lockutils [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] Acquiring lock "singleton_lock" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.617412] env[65660]: DEBUG oslo_concurrency.lockutils [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] Acquired lock "singleton_lock" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.617599] env[65660]: DEBUG oslo_concurrency.lockutils [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] Releasing lock "singleton_lock" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.617890] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] Full set of CONF: {{(pid=65660) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 527.618028] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ******************************************************************************** {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 527.618116] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] Configuration options gathered from: {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 527.618467] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 527.618638] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 527.618746] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ================================================================================ {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 527.618913] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] agent_down_time = 75 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619062] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] allow_automatic_dhcp_failover = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619203] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] allow_bulk = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619346] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] api_extensions_path = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619518] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] api_paste_config = api-paste.ini {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619668] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] auth_strategy = keystone {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619774] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] backdoor_port = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.619876] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] backdoor_socket = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.620033] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] backlog = 4096 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621204] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] base_mac = fa:16:3e:00:00:00 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621204] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] bind_host = 0.0.0.0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621204] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] bind_port = 9696 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621204] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] client_socket_timeout = 900 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621204] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] config_dir = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621204] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621466] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] config_source = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621466] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] control_exchange = neutron {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621466] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] core_plugin = ml2 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621466] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] debug = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621592] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] default_availability_zones = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621808] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.621907] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] dhcp_agent_notification = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622025] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] dhcp_agents_per_network = 1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622143] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] dhcp_lease_duration = 86400 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622284] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] dhcp_load_type = networks {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622418] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] dns_domain = openstacklocal {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622551] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622682] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_default_route_bfd = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622811] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_default_route_ecmp = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.622939] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_dvr = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623076] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_new_agents = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623206] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623332] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_signals = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623459] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] enable_traditional_dhcp = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623586] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] external_dns_driver = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623710] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] filter_validation = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623848] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] global_physnet_mtu = 8950 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.623977] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] graceful_shutdown_timeout = 60 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624182] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] host = cpu-1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624310] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] host_dvr_for_dhcp = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624441] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] http_retries = 3 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624579] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] instance_format = [instance: %(uuid)s] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624714] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624854] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ipam_driver = internal {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.624972] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ipv6_pd_enabled = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625111] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] l3_ha = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625240] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625373] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] l3_ha_network_physical_name = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625504] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] l3_ha_network_type = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625642] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_color = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625775] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_config_append = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.625909] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626049] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_dir = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626179] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_file = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626280] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_options = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626412] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_rotate_interval = 1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626546] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_rotate_interval_type = days {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626684] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] log_rotation_type = none {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626787] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.626885] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.627030] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.627167] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.627318] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.627549] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] max_dns_nameservers = 5 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.627781] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] max_header_line = 16384 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.628015] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] max_l3_agents_per_router = 3 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.628255] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] max_logfile_count = 30 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.628459] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] max_logfile_size_mb = 200 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.628663] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] max_subnet_host_routes = 20 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.628855] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] my_ip = 10.180.1.21 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.629053] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] my_ipv6 = ::1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.629221] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] network_auto_schedule = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.629357] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] network_link_prefix = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.629559] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.629751] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] notify_nova_on_port_data_changes = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.629943] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] notify_nova_on_port_status_changes = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.630158] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] pagination_max_limit = -1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.630339] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] publish_errors = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.630528] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] rate_limit_burst = 0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.630695] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] rate_limit_except_level = CRITICAL {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.630833] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] rate_limit_interval = 0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.630965] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] retry_until_window = 30 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631108] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] router_distributed = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631241] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] rpc_resources_processing_step = 20 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631371] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] rpc_response_max_timeout = 600 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631501] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] rpc_response_timeout = 60 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631630] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] send_events_interval = 2 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631816] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] service_plugins = ['router'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.631990] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] setproctitle = on {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632102] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] shell_completion = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632248] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] state_path = /opt/stack/data/neutron {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632380] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] syslog_log_facility = LOG_USER {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632516] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] tcp_keepidle = 600 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632655] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] transport_url = **** {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632787] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] use_journal = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.632915] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] use_json = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633052] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] use_ssl = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633181] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] use_stderr = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633316] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] use_syslog = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633443] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] vlan_qinq = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633569] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] vlan_transparent = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633696] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] watch_log_file = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633823] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] wsgi_default_pool_size = 100 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.633946] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] wsgi_keep_alive = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.634093] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.634222] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] wsgi_server_debug = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.634369] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_concurrency.disable_process_locking = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.634513] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.634654] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.634786] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.634923] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635070] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635207] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635354] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.connection_string = messaging:// {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635492] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.enabled = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635632] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.es_doc_type = notification {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635764] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.es_scroll_size = 10000 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.635903] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.es_scroll_time = 2m {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.filter_error_trace = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.hmac_keys = **** {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.sentinel_service_name = mymaster {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.socket_timeout = 0.1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.trace_requests = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler.trace_sqlalchemy = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637384] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler_jaeger.process_tags = {} {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637672] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler_jaeger.service_name_prefix = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637672] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] profiler_otlp.service_name_prefix = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637672] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.enforce_new_defaults = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637672] env[65660]: WARNING oslo_config.cfg [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 527.637672] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.enforce_scope = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.637812] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.policy_default_rule = default {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638117] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638117] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638197] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638467] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638467] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638587] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638700] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.638830] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_policy.remote_timeout = 60.0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639590] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639590] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] agent.extensions = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639590] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639590] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] service_providers.service_provider = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639590] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.default_quota = -1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639876] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639876] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_floatingip = 50 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.639970] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_network = 100 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640096] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_port = 500 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640231] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640362] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_router = 10 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640513] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_security_group = 10 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640654] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640786] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.quota_subnet = 100 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.640918] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] QUOTAS.track_quota_usage = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641078] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641213] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.group = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641343] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.helper_command = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641477] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.log_daemon_traceback = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641620] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641769] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.thread_pool_size = 8 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.641920] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep.user = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642085] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642203] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.group = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642332] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.helper_command = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642466] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642603] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642736] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.642864] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_dhcp_release.user = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643020] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643158] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.group = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643287] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.helper_command = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643418] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643553] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643691] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643816] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_ovs_vsctl.user = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.643952] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.capabilities = [21] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644090] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.group = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644221] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.helper_command = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644351] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.log_daemon_traceback = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644485] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644621] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.thread_pool_size = 8 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644750] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_namespace.user = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.644888] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.capabilities = [12] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645025] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.group = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645156] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.helper_command = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645285] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645422] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645563] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645691] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_conntrack.user = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645830] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.capabilities = [12, 21] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.645961] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.group = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646102] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.helper_command = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646236] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.log_daemon_traceback = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646371] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646504] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.thread_pool_size = 8 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646636] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] privsep_link.user = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646785] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.646935] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647081] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.continue_on_failed_promotions = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647215] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.dscp = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647350] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.dscp_inherit = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647488] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.force_mp_to_policy = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647958] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.locking_coordinator_url = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647958] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.log_agent_heartbeats = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.647958] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.logging_expire = 1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648067] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648149] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648285] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.polling_interval = 240 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648418] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648600] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648691] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.report_interval = 30.0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648831] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.648972] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649125] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649259] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.sync_skew = 60 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649392] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.synchronization_queue_size = 20 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649555] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT.use_helper_for_ns_read = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649700] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] SECURITYGROUP.enable_ipset = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649841] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] SECURITYGROUP.enable_security_group = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.649979] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.650134] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.650275] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] experimental.ipv6_pd_enabled = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.650434] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.extension_drivers = ['port_security'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.650584] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.external_network_type = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.650744] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.650890] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.overlay_ip_version = 4 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651041] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.path_mtu = 8950 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651185] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.physical_network_mtus = {} {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651331] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.tenant_network_types = ['vlan'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651473] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651618] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ml2.type_drivers = ['vlan'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651772] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT_CLI.neutron_port_id = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.651926] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652076] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652244] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652364] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652500] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652640] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652780] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.652920] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653136] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653285] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_login_password = **** {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653433] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_login_port = 443 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653572] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_login_user = admin {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653711] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653853] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.653988] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654134] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654274] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654416] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654556] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654695] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654831] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.654969] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.655125] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.655260] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.655397] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.655594] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.655741] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] vsphere.vsphere_login_password = VMware1! {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.655880] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656020] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656164] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.auth_section = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656310] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.auth_type = password {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656451] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656584] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.certfile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656717] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.collect_timing = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656858] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.endpoint_type = public {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.656990] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.insecure = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657129] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.keyfile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657269] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.region_name = RegionOne {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657407] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.split_loggers = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657535] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] nova.timeout = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657670] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.auth_section = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657812] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.auth_type = password {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.657951] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658092] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.certfile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658225] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.collect_timing = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658363] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.endpoint_type = public {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658495] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.insecure = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658625] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.keyfile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658781] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.region_name = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.658875] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.split_loggers = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659007] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] placement.timeout = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659147] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.auth_section = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659279] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.auth_type = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659406] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.cafile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659564] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.certfile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659702] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.collect_timing = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659830] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.connect_retries = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.659960] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.connect_retry_delay = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660107] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.enable_notifications = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660240] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.endpoint_override = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660375] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.insecure = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660507] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.interface = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660658] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.keyfile = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660797] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.max_version = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.660924] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.min_version = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661061] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.region_name = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661194] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.retriable_status_codes = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661322] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.service_name = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661452] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.service_type = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661586] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.split_loggers = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661716] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.status_code_retries = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.661872] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.status_code_retry_delay = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662029] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.timeout = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662154] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.valid_interfaces = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662344] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ironic.version = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662417] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] cli_script.dry_run = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662562] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662696] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662830] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.662962] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663104] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663235] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663359] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663494] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663625] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663765] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.663893] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664040] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664180] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664313] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664445] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664585] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664720] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664852] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.664992] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665139] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665275] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665408] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665540] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665674] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665807] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.665942] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666085] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666220] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666352] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666486] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666619] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.ssl = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666758] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.666899] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667041] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667184] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667325] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.ssl_version = {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667458] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667603] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_notifications.driver = [] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667741] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_notifications.retry = -1 {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.667891] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.668035] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] oslo_messaging_notifications.transport_url = **** {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.668140] env[65660]: DEBUG oslo_service.backend._eventlet.service [None req-b69104de-cf76-4c3f-8f88-439fed989e3d None None] ******************************************************************************** {{(pid=65660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 527.669285] env[65660]: DEBUG neutron.agent.securitygroups_rpc [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Init firewall settings (driver=nsxv3) {{(pid=65660) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 527.670652] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65660) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 527.670891] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] RPC agent_id: nsxm-l-01a.corp.local [ 527.673189] env[65660]: DEBUG dogpile.cache.region [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.673312] env[65660]: DEBUG dogpile.lock [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 527.673408] env[65660]: DEBUG dogpile.lock [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 527.673498] env[65660]: DEBUG dogpile.lock [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 527.673588] env[65660]: DEBUG dogpile.cache.region [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.673674] env[65660]: DEBUG dogpile.lock [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 527.673791] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 527.695895] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Session token - acquiring [ 527.697478] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.697729] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.697792] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.698225] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.709644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.989036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 528.010631] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 528.010834] env[65660]: DEBUG dogpile.cache.region [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Cache value generated in 0.337 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 528.010897] env[65660]: DEBUG dogpile.lock [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 528.011022] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Activating Policy API Provider. [ 528.011217] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Looking for the default Infrastructure Rules. [ 528.095070] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Looking for the Default Layer3 Logged Drop Section. [ 528.111145] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 528.111669] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.111844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.111946] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.112262] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.112593] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.627450] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.129777] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.633963] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Inventory metadata is going to be refreshed. [ 529.633963] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 530.449357] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.449598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.449665] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.449984] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.461656] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 530.462719] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.463381] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 530.480999] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.481239] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.481342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.481722] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.481886] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.482075] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 530.482220] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.482351] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 530.503905] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.504201] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.504323] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.504654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.504864] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.505055] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 530.527611] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.527839] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.527878] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.528412] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.528599] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.528781] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 530.552602] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.552801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.552882] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.553277] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.553462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.553639] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 530.553770] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.553895] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 530.573390] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.573692] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.573824] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.574155] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.574318] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.574490] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 530.574695] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.574837] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 530.597419] env[65660]: DEBUG networking_nsxv3.common.locking [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.597647] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.597763] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.598215] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.598403] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.598588] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 530.598846] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.599045] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Inventory metadata have been refreshed. [ 530.599188] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Dryrun:True. Metadata refresh completed. [ 530.599340] env[65660]: DEBUG oslo_concurrency.lockutils [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Releasing lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.601245] env[65660]: INFO neutron.agent.agent_extensions_manager [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Loaded agent extensions: [] [ 530.602029] env[65660]: DEBUG neutron_lib.callbacks.manager [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65660) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 530.659259] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent RPC Daemon Started! [ 530.659664] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:0 started [ 530.659664] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent out of sync with plugin! [ 535.602978] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.603333] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.605072] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.605454] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.561719] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f868b7de-1c46-4b9f-b10d-7ecbc74a6940 demo admin] Enqueued Resource ID: a1a680dc-e35e-4fae-997a-efd864e88bfd with Priority: HIGHEST for action security_group_rules [ 543.562390] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a680dc-e35e-4fae-997a-efd864e88bfd with Priority: HIGHEST for action security_group_rules [ 543.562705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a680dc-e35e-4fae-997a-efd864e88bfd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.562838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a680dc-e35e-4fae-997a-efd864e88bfd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.562905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a680dc-e35e-4fae-997a-efd864e88bfd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.563295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a680dc-e35e-4fae-997a-efd864e88bfd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.563385] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a680dc-e35e-4fae-997a-efd864e88bfd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.086365] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.086588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.086940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.087044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.087168] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a680dc-e35e-4fae-997a-efd864e88bfd already deleted. [ 544.087285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a680dc-e35e-4fae-997a-efd864e88bfd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.605766] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.606198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.606198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.606198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.606421] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.110089] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.612471] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.115449] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 547.115634] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 547.903456] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.903879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.903879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.903879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.915738] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 547.916581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.917233] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 547.934256] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.934445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.934519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.934693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.934776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.934885] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 547.934957] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.935042] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 547.954654] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.954868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.954868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.955079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.955225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.955333] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.977322] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.977562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.977562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.977769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.977904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.978036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.999014] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.999234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.999234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.999440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.999541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.999653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 547.999725] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.999806] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 548.018000] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.018236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.018236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.018498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.018589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.018699] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 548.018770] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 548.018839] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 548.039584] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.039888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.039888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.040060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.040165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.040280] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 548.040350] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 548.040418] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 548.040482] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 548.040556] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 548.040618] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 548.040679] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 548.040983] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 548.041072] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 548.041126] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 548.062092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.062356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.062356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.062515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.062623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.062734] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 548.084167] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.084461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.084461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.084655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.084761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.113246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.564231] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.564446] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.565595] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.566255] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.567737] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.568178] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.569020] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.569451] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.570509] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.570847] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.295419] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d3961455-5685-40c8-8e37-44cd457b9125 None None] Enqueued Resource ID: 3cd45309-95e5-4899-a39b-c201ca87e8f6 with Priority: HIGHEST for action port [ 570.295419] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd45309-95e5-4899-a39b-c201ca87e8f6 with Priority: HIGHEST for action port [ 570.295419] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd45309-95e5-4899-a39b-c201ca87e8f6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.295419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd45309-95e5-4899-a39b-c201ca87e8f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.295419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd45309-95e5-4899-a39b-c201ca87e8f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.296638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd45309-95e5-4899-a39b-c201ca87e8f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.296771] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd45309-95e5-4899-a39b-c201ca87e8f6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.801739] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cd45309-95e5-4899-a39b-c201ca87e8f6 [ 570.802489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.802489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.802489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.802489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.802489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.802738] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cd45309-95e5-4899-a39b-c201ca87e8f6 already deleted. [ 570.802738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd45309-95e5-4899-a39b-c201ca87e8f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.807044] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5d962852-9553-46e7-9ee9-6f53cbafb59f None None] Enqueued Resource ID: 7992c2d1-75ba-4b93-b0f7-ff57350f6b90 with Priority: HIGHEST for action port [ 571.807724] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7992c2d1-75ba-4b93-b0f7-ff57350f6b90 with Priority: HIGHEST for action port [ 571.807968] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7992c2d1-75ba-4b93-b0f7-ff57350f6b90 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.808129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7992c2d1-75ba-4b93-b0f7-ff57350f6b90" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.808235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7992c2d1-75ba-4b93-b0f7-ff57350f6b90" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.808473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7992c2d1-75ba-4b93-b0f7-ff57350f6b90" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.808620] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7992c2d1-75ba-4b93-b0f7-ff57350f6b90',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.257269] env[65660]: INFO networking_nsxv3.common.synchronization [None req-cb7f6fd2-4af8-4e01-9c1d-5a2568d64808 None None] Enqueued Resource ID: bd8ba441-329f-46d6-882d-d4a702fea4ad with Priority: HIGHEST for action port [ 572.258252] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8ba441-329f-46d6-882d-d4a702fea4ad with Priority: HIGHEST for action port [ 572.258617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd8ba441-329f-46d6-882d-d4a702fea4ad taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.259281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd8ba441-329f-46d6-882d-d4a702fea4ad" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.259408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd8ba441-329f-46d6-882d-d4a702fea4ad" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.259746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd8ba441-329f-46d6-882d-d4a702fea4ad" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.260020] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd8ba441-329f-46d6-882d-d4a702fea4ad',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.310147] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7992c2d1-75ba-4b93-b0f7-ff57350f6b90 [ 572.310425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.310817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.310894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.311465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.311565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.311996] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7992c2d1-75ba-4b93-b0f7-ff57350f6b90 already deleted. [ 572.312112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7992c2d1-75ba-4b93-b0f7-ff57350f6b90" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.765759] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd8ba441-329f-46d6-882d-d4a702fea4ad [ 572.765759] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.765759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.765759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.765759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.765759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.765759] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd8ba441-329f-46d6-882d-d4a702fea4ad already deleted. [ 572.765759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd8ba441-329f-46d6-882d-d4a702fea4ad" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.971585] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ce9f8748-e366-4247-b42e-84a7edf0b7b4 None None] Enqueued Resource ID: 6b8ff075-88c5-4f3a-89c1-ebe5d623e513 with Priority: HIGHEST for action port [ 573.972688] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8ff075-88c5-4f3a-89c1-ebe5d623e513 with Priority: HIGHEST for action port [ 573.972688] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b8ff075-88c5-4f3a-89c1-ebe5d623e513 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.972938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b8ff075-88c5-4f3a-89c1-ebe5d623e513" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.972938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b8ff075-88c5-4f3a-89c1-ebe5d623e513" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.973100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b8ff075-88c5-4f3a-89c1-ebe5d623e513" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.973787] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b8ff075-88c5-4f3a-89c1-ebe5d623e513',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.476318] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b8ff075-88c5-4f3a-89c1-ebe5d623e513 [ 574.476549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.476983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.477089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.477308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.477403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.477574] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b8ff075-88c5-4f3a-89c1-ebe5d623e513 already deleted. [ 574.477836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b8ff075-88c5-4f3a-89c1-ebe5d623e513" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.798165] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6d390d72-8f9a-4e07-b3f5-c9c37e1d7bf4 None None] Enqueued Resource ID: b596e582-65cc-4441-a029-609cd8a43483 with Priority: HIGHEST for action port [ 574.798696] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b596e582-65cc-4441-a029-609cd8a43483 with Priority: HIGHEST for action port [ 574.798992] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b596e582-65cc-4441-a029-609cd8a43483 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.799151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b596e582-65cc-4441-a029-609cd8a43483" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.799185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b596e582-65cc-4441-a029-609cd8a43483" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.800926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b596e582-65cc-4441-a029-609cd8a43483" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.801032] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b596e582-65cc-4441-a029-609cd8a43483',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.051024] env[65660]: INFO networking_nsxv3.common.synchronization [None req-17de8c5e-7791-4b0e-a36e-290e02d5b6f0 None None] Enqueued Resource ID: b3f9ede9-423e-46ab-a3ce-9472665b8381 with Priority: HIGHEST for action port [ 575.051024] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3f9ede9-423e-46ab-a3ce-9472665b8381 with Priority: HIGHEST for action port [ 575.051024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3f9ede9-423e-46ab-a3ce-9472665b8381 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.051716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3f9ede9-423e-46ab-a3ce-9472665b8381" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.052344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3f9ede9-423e-46ab-a3ce-9472665b8381" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.052570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3f9ede9-423e-46ab-a3ce-9472665b8381" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.053895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3f9ede9-423e-46ab-a3ce-9472665b8381',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.303685] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b596e582-65cc-4441-a029-609cd8a43483 [ 575.303685] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.303685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.303685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.304013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.304013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.304316] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b596e582-65cc-4441-a029-609cd8a43483 already deleted. [ 575.304316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b596e582-65cc-4441-a029-609cd8a43483" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.555183] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3f9ede9-423e-46ab-a3ce-9472665b8381 [ 575.555183] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.555183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.555183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.555660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.555660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.555660] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3f9ede9-423e-46ab-a3ce-9472665b8381 already deleted. [ 575.555660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3f9ede9-423e-46ab-a3ce-9472665b8381" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.099488] env[65660]: INFO networking_nsxv3.common.synchronization [None req-3ce8022d-c523-407e-b7bb-67c7894c501b None None] Enqueued Resource ID: d60fb6b7-e3e6-4f67-86c2-c01162da9ce0 with Priority: HIGHEST for action port [ 576.100366] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d60fb6b7-e3e6-4f67-86c2-c01162da9ce0 with Priority: HIGHEST for action port [ 576.100489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d60fb6b7-e3e6-4f67-86c2-c01162da9ce0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.100844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d60fb6b7-e3e6-4f67-86c2-c01162da9ce0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.100844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d60fb6b7-e3e6-4f67-86c2-c01162da9ce0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.101019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d60fb6b7-e3e6-4f67-86c2-c01162da9ce0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.101019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d60fb6b7-e3e6-4f67-86c2-c01162da9ce0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.603279] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d60fb6b7-e3e6-4f67-86c2-c01162da9ce0 [ 576.603526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.604153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.604274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.604494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.605641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.605641] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d60fb6b7-e3e6-4f67-86c2-c01162da9ce0 already deleted. [ 576.605641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d60fb6b7-e3e6-4f67-86c2-c01162da9ce0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.934985] env[65660]: INFO networking_nsxv3.common.synchronization [None req-1a0b83c4-9a39-4618-9466-a17262592882 None None] Enqueued Resource ID: 9faa60b1-9ca2-436b-99d9-bc3c1144bd88 with Priority: HIGHEST for action port [ 576.938258] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9faa60b1-9ca2-436b-99d9-bc3c1144bd88 with Priority: HIGHEST for action port [ 576.938258] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9faa60b1-9ca2-436b-99d9-bc3c1144bd88 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.938258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9faa60b1-9ca2-436b-99d9-bc3c1144bd88" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.938258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9faa60b1-9ca2-436b-99d9-bc3c1144bd88" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.938258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9faa60b1-9ca2-436b-99d9-bc3c1144bd88" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.938258] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9faa60b1-9ca2-436b-99d9-bc3c1144bd88',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.440592] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9faa60b1-9ca2-436b-99d9-bc3c1144bd88 [ 577.440825] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.441624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.441624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.441624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.441624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.441624] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9faa60b1-9ca2-436b-99d9-bc3c1144bd88 already deleted. [ 577.441624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9faa60b1-9ca2-436b-99d9-bc3c1144bd88" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.912192] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ab60fdfb-3e3e-44ae-9d57-1f7d9a00a42f None None] Enqueued Resource ID: e0854385-5050-44a7-8cf8-4d06a3c0f778 with Priority: HIGHEST for action port [ 577.913110] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0854385-5050-44a7-8cf8-4d06a3c0f778 with Priority: HIGHEST for action port [ 577.914476] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0854385-5050-44a7-8cf8-4d06a3c0f778 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.914657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0854385-5050-44a7-8cf8-4d06a3c0f778" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.914838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0854385-5050-44a7-8cf8-4d06a3c0f778" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.915194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0854385-5050-44a7-8cf8-4d06a3c0f778" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.915282] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0854385-5050-44a7-8cf8-4d06a3c0f778',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.419400] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0854385-5050-44a7-8cf8-4d06a3c0f778 [ 578.419679] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.419847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.420015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.420248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.420386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.420486] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0854385-5050-44a7-8cf8-4d06a3c0f778 already deleted. [ 578.420569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0854385-5050-44a7-8cf8-4d06a3c0f778" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.956379] env[65660]: INFO networking_nsxv3.common.synchronization [None req-3314caec-4507-43ff-8417-0ba1ce81b849 None None] Enqueued Resource ID: b2a819fb-8141-48a0-a507-0f36c9079d64 with Priority: HIGHEST for action port [ 578.956653] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2a819fb-8141-48a0-a507-0f36c9079d64 with Priority: HIGHEST for action port [ 578.957209] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2a819fb-8141-48a0-a507-0f36c9079d64 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.957335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2a819fb-8141-48a0-a507-0f36c9079d64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.957401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2a819fb-8141-48a0-a507-0f36c9079d64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.957649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2a819fb-8141-48a0-a507-0f36c9079d64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.957729] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a819fb-8141-48a0-a507-0f36c9079d64',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.331486] env[65660]: INFO networking_nsxv3.common.synchronization [None req-dad43581-d852-44a5-a77a-6860e5399b6c None None] Enqueued Resource ID: 2ceee8be-ec2b-495b-85a8-ad7ec1ffe450 with Priority: HIGHEST for action port [ 579.332031] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ceee8be-ec2b-495b-85a8-ad7ec1ffe450 with Priority: HIGHEST for action port [ 579.332234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ceee8be-ec2b-495b-85a8-ad7ec1ffe450 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.332649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ceee8be-ec2b-495b-85a8-ad7ec1ffe450" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.332649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ceee8be-ec2b-495b-85a8-ad7ec1ffe450" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.333788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ceee8be-ec2b-495b-85a8-ad7ec1ffe450" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.333788] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ceee8be-ec2b-495b-85a8-ad7ec1ffe450',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.459908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2a819fb-8141-48a0-a507-0f36c9079d64 [ 579.460498] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.460498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.460498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.460705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.460785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.460875] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2a819fb-8141-48a0-a507-0f36c9079d64 already deleted. [ 579.460956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2a819fb-8141-48a0-a507-0f36c9079d64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.606092] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2fd43d59-9529-4c73-870d-4f99cf680c16 None None] Enqueued Resource ID: de3f1b09-fd9a-4274-884d-0b0d10994c11 with Priority: HIGHEST for action port [ 579.607478] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de3f1b09-fd9a-4274-884d-0b0d10994c11 with Priority: HIGHEST for action port [ 579.607478] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-de3f1b09-fd9a-4274-884d-0b0d10994c11 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.607478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de3f1b09-fd9a-4274-884d-0b0d10994c11" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.607977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de3f1b09-fd9a-4274-884d-0b0d10994c11" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.608226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de3f1b09-fd9a-4274-884d-0b0d10994c11" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.608460] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de3f1b09-fd9a-4274-884d-0b0d10994c11',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.837195] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ceee8be-ec2b-495b-85a8-ad7ec1ffe450 [ 579.838850] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.838850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.838850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.838850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.838850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.838850] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ceee8be-ec2b-495b-85a8-ad7ec1ffe450 already deleted. [ 579.838850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ceee8be-ec2b-495b-85a8-ad7ec1ffe450" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.112125] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de3f1b09-fd9a-4274-884d-0b0d10994c11 [ 580.112387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.113296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.113296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.113296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.113296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.113296] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de3f1b09-fd9a-4274-884d-0b0d10994c11 already deleted. [ 580.113296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de3f1b09-fd9a-4274-884d-0b0d10994c11" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.296307] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2b70e4d0-4260-4626-b8b1-24578ce27419 None None] Enqueued Resource ID: d9bed753-af43-4bd2-ab79-d3320ed6a808 with Priority: HIGHEST for action port [ 580.296307] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9bed753-af43-4bd2-ab79-d3320ed6a808 with Priority: HIGHEST for action port [ 580.299438] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9bed753-af43-4bd2-ab79-d3320ed6a808 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.299438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9bed753-af43-4bd2-ab79-d3320ed6a808" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.299438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9bed753-af43-4bd2-ab79-d3320ed6a808" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.299438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9bed753-af43-4bd2-ab79-d3320ed6a808" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.299438] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9bed753-af43-4bd2-ab79-d3320ed6a808',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.342426] env[65660]: INFO networking_nsxv3.common.synchronization [None req-00b89eb2-899d-41d4-a77f-f83633819c02 None None] Enqueued Resource ID: 761d8dca-eadb-4185-a626-d98151df761b with Priority: HIGHEST for action port [ 580.343048] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 761d8dca-eadb-4185-a626-d98151df761b with Priority: HIGHEST for action port [ 580.343624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-761d8dca-eadb-4185-a626-d98151df761b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.343624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-761d8dca-eadb-4185-a626-d98151df761b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.343869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-761d8dca-eadb-4185-a626-d98151df761b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.344017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-761d8dca-eadb-4185-a626-d98151df761b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.344187] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('761d8dca-eadb-4185-a626-d98151df761b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.801960] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9bed753-af43-4bd2-ab79-d3320ed6a808 [ 580.801960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.801960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.801960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.801960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.801960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.801960] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9bed753-af43-4bd2-ab79-d3320ed6a808 already deleted. [ 580.801960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9bed753-af43-4bd2-ab79-d3320ed6a808" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.847283] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 761d8dca-eadb-4185-a626-d98151df761b [ 580.847283] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.847865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.847993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.848218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.848311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.848411] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:761d8dca-eadb-4185-a626-d98151df761b already deleted. [ 580.848494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-761d8dca-eadb-4185-a626-d98151df761b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.135214] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d1fbffa9-b296-40d1-b473-8f64257feb8a tempest-ServersTestBootFromVolume-443678150 tempest-ServersTestBootFromVolume-443678150-project-member] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_rules [ 582.136013] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_rules [ 582.136101] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.136181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.136251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.136497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.136786] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.253157] env[65660]: INFO networking_nsxv3.common.synchronization [None req-e57c30a5-28bb-4e5b-aa3c-5cc89a68aaec tempest-ServersTestBootFromVolume-443678150 tempest-ServersTestBootFromVolume-443678150-project-member] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_rules [ 582.253157] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_rules [ 582.253599] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.253955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.660557] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.662455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.662586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.662872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.663034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.663138] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 already deleted. [ 582.663318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.663370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.663531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.663614] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.185705] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa40f2a5-6663-49f9-aeb6-13d8bc49b737 req-463c3936-eee1-45bc-9e91-88c6b557952c tempest-ImagesNegativeTestJSON-453915284 tempest-ImagesNegativeTestJSON-453915284-project-member] Enqueued Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_members [ 583.186770] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.187131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.187131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.187657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.187657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.187736] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 already deleted. [ 583.188389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.188564] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_members [ 583.190182] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.190182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.190351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.190566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.190746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.192355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.192355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.192355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.192355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.192355] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.696665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.696665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.696665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.697093] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 already deleted. [ 583.697093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.859294] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.859495] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-375" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.859616] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-375" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.859904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-375" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.860741] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.860899] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.862176] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.863343] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.863598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.863933] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.864185] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.864319] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.864433] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.864582] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.864732] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.864859] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.884945] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.885091] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.885247] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.885407] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-375" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.885716] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-c3b62363-98d8-487b-ae35-46b8b1993e61 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.885889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.886019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.886360] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.886495] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b62363-98d8-487b-ae35-46b8b1993e61',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.389760] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.390174] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.390174] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.390416] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.390572] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.390720] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port c3b62363-98d8-487b-ae35-46b8b1993e61 not found, creating... [ 584.391318] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.391318] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.391318] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.391924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.391924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.391979] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.392102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.392240] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.392433] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.392568] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.392703] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: c3b62363-98d8-487b-ae35-46b8b1993e61 is going to be created. [ 584.418616] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.418851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.418977] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.419297] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.419550] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.419805] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.581718] env[65660]: INFO networking_nsxv3.common.synchronization [None req-feb5ef37-77cf-43fe-b7f8-8ad8d42ad7b6 None None] Enqueued Resource ID: a033e6b9-8611-4bd5-a628-dde651dbbd87 with Priority: HIGHEST for action port [ 584.581718] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a033e6b9-8611-4bd5-a628-dde651dbbd87 with Priority: HIGHEST for action port [ 584.581718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a033e6b9-8611-4bd5-a628-dde651dbbd87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.581718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a033e6b9-8611-4bd5-a628-dde651dbbd87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.581718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a033e6b9-8611-4bd5-a628-dde651dbbd87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.581718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a033e6b9-8611-4bd5-a628-dde651dbbd87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.581718] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a033e6b9-8611-4bd5-a628-dde651dbbd87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.048027] env[65660]: INFO networking_nsxv3.common.synchronization [None req-fa42bb4e-0143-4bdb-85d6-9b8f4f9b3e30 None None] Enqueued Resource ID: 252248ca-4af3-47f3-98df-ea64f83ddfc4 with Priority: HIGHEST for action port [ 585.048027] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 252248ca-4af3-47f3-98df-ea64f83ddfc4 with Priority: HIGHEST for action port [ 585.048027] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-252248ca-4af3-47f3-98df-ea64f83ddfc4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.048323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-252248ca-4af3-47f3-98df-ea64f83ddfc4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.048323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-252248ca-4af3-47f3-98df-ea64f83ddfc4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.048542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-252248ca-4af3-47f3-98df-ea64f83ddfc4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.048598] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('252248ca-4af3-47f3-98df-ea64f83ddfc4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.088453] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a033e6b9-8611-4bd5-a628-dde651dbbd87 [ 585.088723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.088908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.088953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.089177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.089271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.089365] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a033e6b9-8611-4bd5-a628-dde651dbbd87 already deleted. [ 585.089450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a033e6b9-8611-4bd5-a628-dde651dbbd87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.222291] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa40f2a5-6663-49f9-aeb6-13d8bc49b737 req-f33e75da-8726-4fef-aeba-13cf4460119a service nova] Enqueued Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_rules [ 585.222291] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa40f2a5-6663-49f9-aeb6-13d8bc49b737 req-f33e75da-8726-4fef-aeba-13cf4460119a service nova] Enqueued Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_members [ 585.222291] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa40f2a5-6663-49f9-aeb6-13d8bc49b737 req-f33e75da-8726-4fef-aeba-13cf4460119a service nova] Enqueued Resource ID: c3b62363-98d8-487b-ae35-46b8b1993e61 with Priority: HIGHEST for action port [ 585.222291] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_rules [ 585.222291] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_members [ 585.222291] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b62363-98d8-487b-ae35-46b8b1993e61 with Priority: HIGHEST for action port [ 585.222871] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.222999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.223078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.223325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.223406] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.224687] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.224801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.224866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.225058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.225313] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.225436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.225497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.225647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.225728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.225813] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.227325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b62363-98d8-487b-ae35-46b8b1993e61 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.227403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.227442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.229031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.229031] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b62363-98d8-487b-ae35-46b8b1993e61',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.553862] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 252248ca-4af3-47f3-98df-ea64f83ddfc4 [ 585.554148] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.555083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.555083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.555083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.555083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.555083] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:252248ca-4af3-47f3-98df-ea64f83ddfc4 already deleted. [ 585.555083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-252248ca-4af3-47f3-98df-ea64f83ddfc4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.725894] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.727256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.727973] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.729199] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b62363-98d8-487b-ae35-46b8b1993e61 with status ACTIVE [ 585.731162] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.731162] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.731162] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.731162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.731911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.731911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.731911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.731911] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b62363-98d8-487b-ae35-46b8b1993e61 is going to be updated. [ 585.757756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.757756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.757756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.758045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.758428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.758428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b62363-98d8-487b-ae35-46b8b1993e61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.991017] env[65660]: INFO networking_nsxv3.common.synchronization [req-d71c1243-d7dd-4f5b-b026-4801ba7f0ddd req-ca092cc1-9435-4422-8804-a80990869598 tempest-ServerDiagnosticsNegativeTest-1273104442 tempest-ServerDiagnosticsNegativeTest-1273104442-project-member] Enqueued Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_members [ 585.994845] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_members [ 585.995662] env[65660]: INFO networking_nsxv3.common.synchronization [None req-7f5b9c43-7317-413d-9579-7754ef6c2c64 None None] Enqueued Resource ID: f54e3267-3f1e-4e21-afc9-e73e55746d79 with Priority: HIGHEST for action port [ 585.996112] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.996112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.996270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.996433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.996578] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.996676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.997664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.998361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.998499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.998941] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.001349] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54e3267-3f1e-4e21-afc9-e73e55746d79 with Priority: HIGHEST for action port [ 586.001349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f54e3267-3f1e-4e21-afc9-e73e55746d79 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.001722] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f54e3267-3f1e-4e21-afc9-e73e55746d79" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.001722] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f54e3267-3f1e-4e21-afc9-e73e55746d79" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.002615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f54e3267-3f1e-4e21-afc9-e73e55746d79" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.002615] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54e3267-3f1e-4e21-afc9-e73e55746d79',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.229734] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.502431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.502666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.502738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.502986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.503114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.503329] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.503430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.503500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.503658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.503764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.503818] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d already deleted. [ 586.504376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.507858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f54e3267-3f1e-4e21-afc9-e73e55746d79 [ 586.508048] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.508164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.508232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.509340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.509340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.509340] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f54e3267-3f1e-4e21-afc9-e73e55746d79 already deleted. [ 586.509340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f54e3267-3f1e-4e21-afc9-e73e55746d79" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.732499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.732757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.732757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.732955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.733059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.733152] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 is going to be created. [ 586.793607] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.793694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.793743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.793954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.794130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.809549] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 in Status: UNINITIALIZED for 2s [ 586.826565] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.826803] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.826929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.828502] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.828502] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.828502] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.828502] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.828502] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.828502] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.828867] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.828867] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.828867] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.828968] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.829308] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.829308] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.829403] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.849191] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.849410] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.849526] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.849717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.850147] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-5bb7de18-d107-4a5c-be08-8be088980177 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.850322] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.850464] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.850783] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.850929] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bb7de18-d107-4a5c-be08-8be088980177',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.298808] env[65660]: INFO networking_nsxv3.common.synchronization [None req-3f994da7-599e-4a44-a266-c491d56cc4b5 None None] Enqueued Resource ID: f8f54f68-69a5-46f4-8c58-7613a947ccff with Priority: HIGHEST for action port [ 587.298808] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f54f68-69a5-46f4-8c58-7613a947ccff with Priority: HIGHEST for action port [ 587.298808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f54f68-69a5-46f4-8c58-7613a947ccff taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.298808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f54f68-69a5-46f4-8c58-7613a947ccff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.298808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f54f68-69a5-46f4-8c58-7613a947ccff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.298808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f54f68-69a5-46f4-8c58-7613a947ccff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.298808] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f54f68-69a5-46f4-8c58-7613a947ccff',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.353701] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.354036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.354229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.354577] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.354782] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.355075] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 5bb7de18-d107-4a5c-be08-8be088980177 not found, creating... [ 587.356088] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.356088] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.356088] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.356934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.356934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.356934] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.357072] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.357333] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.357611] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.357825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.358037] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 5bb7de18-d107-4a5c-be08-8be088980177 is going to be created. [ 587.372423] env[65660]: INFO networking_nsxv3.common.synchronization [None req-8ec45ede-8044-4bd7-b91a-7fbc64cc7e62 None None] Enqueued Resource ID: cf141964-8cb8-4b0b-ae75-ed37db390754 with Priority: HIGHEST for action port [ 587.372953] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf141964-8cb8-4b0b-ae75-ed37db390754 with Priority: HIGHEST for action port [ 587.373313] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf141964-8cb8-4b0b-ae75-ed37db390754 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.373444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf141964-8cb8-4b0b-ae75-ed37db390754" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.373513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf141964-8cb8-4b0b-ae75-ed37db390754" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.373834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf141964-8cb8-4b0b-ae75-ed37db390754" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.373834] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf141964-8cb8-4b0b-ae75-ed37db390754',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.404308] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.404553] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.404677] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.407542] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.407542] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.407774] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.410997] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b7593403-2349-4af9-b79a-9bbf165994ec None None] Enqueued Resource ID: 75f5a009-8425-479c-8889-fd593bc9243a with Priority: HIGHEST for action port [ 587.414256] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f5a009-8425-479c-8889-fd593bc9243a with Priority: HIGHEST for action port [ 587.414502] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-75f5a009-8425-479c-8889-fd593bc9243a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.414637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75f5a009-8425-479c-8889-fd593bc9243a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.414705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75f5a009-8425-479c-8889-fd593bc9243a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.414988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75f5a009-8425-479c-8889-fd593bc9243a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.415086] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75f5a009-8425-479c-8889-fd593bc9243a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.802196] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8f54f68-69a5-46f4-8c58-7613a947ccff [ 587.802668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.802668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.802668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.802912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.803028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.803154] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8f54f68-69a5-46f4-8c58-7613a947ccff already deleted. [ 587.803261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f54f68-69a5-46f4-8c58-7613a947ccff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.876889] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf141964-8cb8-4b0b-ae75-ed37db390754 [ 587.877823] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.878718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.878718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.878850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.878850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.878962] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf141964-8cb8-4b0b-ae75-ed37db390754 already deleted. [ 587.879203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf141964-8cb8-4b0b-ae75-ed37db390754" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.920396] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75f5a009-8425-479c-8889-fd593bc9243a [ 587.920396] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.920396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.920396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.920396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.920396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.920396] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75f5a009-8425-479c-8889-fd593bc9243a already deleted. [ 587.920396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75f5a009-8425-479c-8889-fd593bc9243a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.132021] env[65660]: INFO networking_nsxv3.common.synchronization [req-d71c1243-d7dd-4f5b-b026-4801ba7f0ddd req-e2274551-cb01-445b-8bc5-456a78048692 service nova] Enqueued Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_rules [ 588.132021] env[65660]: INFO networking_nsxv3.common.synchronization [req-d71c1243-d7dd-4f5b-b026-4801ba7f0ddd req-e2274551-cb01-445b-8bc5-456a78048692 service nova] Enqueued Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_members [ 588.132021] env[65660]: INFO networking_nsxv3.common.synchronization [req-d71c1243-d7dd-4f5b-b026-4801ba7f0ddd req-e2274551-cb01-445b-8bc5-456a78048692 service nova] Enqueued Resource ID: 5bb7de18-d107-4a5c-be08-8be088980177 with Priority: HIGHEST for action port [ 588.132021] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_rules [ 588.132021] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_members [ 588.132021] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bb7de18-d107-4a5c-be08-8be088980177 with Priority: HIGHEST for action port [ 588.132021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.132780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.135514] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.135514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.135514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.135514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.135514] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.138373] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bb7de18-d107-4a5c-be08-8be088980177 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.138487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.138798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.139018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.140190] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bb7de18-d107-4a5c-be08-8be088980177',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.643728] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.644079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.653670] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bb7de18-d107-4a5c-be08-8be088980177 with status ACTIVE [ 588.656417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.656417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.656417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.656417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.656417] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bb7de18-d107-4a5c-be08-8be088980177 is going to be updated. [ 588.659322] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.680844] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.681050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.681050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.681262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.681405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.681585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bb7de18-d107-4a5c-be08-8be088980177" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.823135] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 in Status: SUCCESS [ 588.823521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.823628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.824420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.824420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.824420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.824420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.824420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.824420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.824420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.824875] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.160875] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.213045] env[65660]: INFO networking_nsxv3.common.synchronization [req-ed53e9e3-a0db-4a69-a5ae-f7efa2a89358 req-7c031d4e-25cb-495b-a3ce-392fbf3e2e83 tempest-DeleteServersAdminTestJSON-1249113108 tempest-DeleteServersAdminTestJSON-1249113108-project-member] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 589.213651] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 589.214312] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.214907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.215044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.215365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.215594] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.215714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.215794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.217508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.217657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.217770] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.328980] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.329276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.329391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.329963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.330208] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.330369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.330504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.330728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.330871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.330957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.331137] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.331239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.331300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.331467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.331638] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.331733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.331791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.332242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.332480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.332631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.332756] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.665706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.665706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.665706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.665706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.665706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.665706] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d is going to be created. [ 589.693052] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.693052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.693052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.693052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.693052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.702217] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d in Status: UNINITIALIZED for 2s [ 589.722179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.722179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.722179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.722179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.722179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.722414] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.722414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.722414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.722569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.722671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.722746] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 already deleted. [ 589.722819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.783511] env[65660]: INFO networking_nsxv3.common.synchronization [None req-8395ecd6-d603-4ddc-8cd5-4ed4694a31cc None None] Enqueued Resource ID: 46bbae8c-a614-4a8d-85e4-af04ff36574e with Priority: HIGHEST for action port [ 589.784381] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46bbae8c-a614-4a8d-85e4-af04ff36574e with Priority: HIGHEST for action port [ 589.784808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-46bbae8c-a614-4a8d-85e4-af04ff36574e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.785352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46bbae8c-a614-4a8d-85e4-af04ff36574e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.785352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46bbae8c-a614-4a8d-85e4-af04ff36574e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.785352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46bbae8c-a614-4a8d-85e4-af04ff36574e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.785476] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46bbae8c-a614-4a8d-85e4-af04ff36574e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.835764] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e668c0d3-6bc9-4aa1-941b-9707aedef834: rpc.has_security_group_logging(os_id): False [ 589.840126] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.840523] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.840761] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.841156] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.841649] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.841869] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.842087] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.842902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.842902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.843107] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.843283] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.843639] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.843639] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.843639] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.843754] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.843868] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.867685] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.867837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.868137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.868137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.868255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.868412] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.869047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.869047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.869047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.869047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.869227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.869227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.869337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.869431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.869467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.869640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.869730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.869787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.869925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.870058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.870147] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 is going to be created. [ 589.873957] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.874114] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.874243] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.874400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.874677] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-e579644c-b007-48d7-b23e-dee9d367c0af taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.874830] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.874938] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.875500] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.875500] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e579644c-b007-48d7-b23e-dee9d367c0af',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.945200] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.945385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.945385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.945584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.945763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.960403] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 in Status: IN_PROGRESS for 2s [ 590.287536] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46bbae8c-a614-4a8d-85e4-af04ff36574e [ 590.287770] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.287969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.288079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.288344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.288436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.288532] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46bbae8c-a614-4a8d-85e4-af04ff36574e already deleted. [ 590.288607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46bbae8c-a614-4a8d-85e4-af04ff36574e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.377605] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.377847] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.377965] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.378233] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.378515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.378814] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port e579644c-b007-48d7-b23e-dee9d367c0af not found, creating... [ 590.379145] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.379344] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.379493] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.379755] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.379926] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.380849] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.380849] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.380849] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.380849] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.381182] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.381182] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: e579644c-b007-48d7-b23e-dee9d367c0af is going to be created. [ 590.402391] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.402607] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.402711] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.403401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.403636] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.404390] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.758231] env[65660]: INFO networking_nsxv3.common.synchronization [None req-0b917ab5-ae4a-4e1b-a4fa-0f80de747f5c None None] Enqueued Resource ID: 62976220-18c3-437c-9e91-415b7aaad37a with Priority: HIGHEST for action port [ 590.758402] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62976220-18c3-437c-9e91-415b7aaad37a with Priority: HIGHEST for action port [ 590.759500] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-62976220-18c3-437c-9e91-415b7aaad37a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.759500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62976220-18c3-437c-9e91-415b7aaad37a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.759500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62976220-18c3-437c-9e91-415b7aaad37a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.759827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62976220-18c3-437c-9e91-415b7aaad37a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.759925] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62976220-18c3-437c-9e91-415b7aaad37a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.233783] env[65660]: INFO networking_nsxv3.common.synchronization [req-ed53e9e3-a0db-4a69-a5ae-f7efa2a89358 req-89be7618-db3c-4fcd-8a07-fe3b006933c2 service nova] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_rules [ 591.234062] env[65660]: INFO networking_nsxv3.common.synchronization [req-ed53e9e3-a0db-4a69-a5ae-f7efa2a89358 req-89be7618-db3c-4fcd-8a07-fe3b006933c2 service nova] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 591.234103] env[65660]: INFO networking_nsxv3.common.synchronization [req-ed53e9e3-a0db-4a69-a5ae-f7efa2a89358 req-89be7618-db3c-4fcd-8a07-fe3b006933c2 service nova] Enqueued Resource ID: e579644c-b007-48d7-b23e-dee9d367c0af with Priority: HIGHEST for action port [ 591.234321] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_rules [ 591.234445] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 591.234620] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e579644c-b007-48d7-b23e-dee9d367c0af with Priority: HIGHEST for action port [ 591.235633] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.235812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.235926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.236163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.236246] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.237469] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.237646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.237796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.239931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.239931] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.239931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.239931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.240800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.240941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.241061] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.241930] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e579644c-b007-48d7-b23e-dee9d367c0af taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.242054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.242122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.242278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.242350] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e579644c-b007-48d7-b23e-dee9d367c0af',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.262930] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62976220-18c3-437c-9e91-415b7aaad37a [ 591.263194] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.263342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.263409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.263608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.263696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.263785] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62976220-18c3-437c-9e91-415b7aaad37a already deleted. [ 591.263944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62976220-18c3-437c-9e91-415b7aaad37a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.351903] env[65660]: INFO networking_nsxv3.common.synchronization [None req-79d0bcba-77b1-45e1-bdcd-fc57b38f650a None None] Enqueued Resource ID: 88e7a143-d5c4-4e09-8dc2-81b19d567fd2 with Priority: HIGHEST for action port [ 591.352577] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88e7a143-d5c4-4e09-8dc2-81b19d567fd2 with Priority: HIGHEST for action port [ 591.352923] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-88e7a143-d5c4-4e09-8dc2-81b19d567fd2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.353011] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88e7a143-d5c4-4e09-8dc2-81b19d567fd2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.353058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88e7a143-d5c4-4e09-8dc2-81b19d567fd2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.353312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88e7a143-d5c4-4e09-8dc2-81b19d567fd2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.353389] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88e7a143-d5c4-4e09-8dc2-81b19d567fd2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.415849] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bdb16f8-c092-4458-8987-a5e007fd9d6e req-ecfe1b38-c0b9-4386-b682-719b4bb9b829 tempest-ServerDiagnosticsTest-1890152622 tempest-ServerDiagnosticsTest-1890152622-project-member] Enqueued Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_members [ 591.416540] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_members [ 591.416840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.416964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.419097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.419656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.419656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.419656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.419656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.419864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.419864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.419946] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.714353] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d in Status: SUCCESS [ 591.714582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.716038] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.716038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.716038] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.744849] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.744849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.744849] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.745888] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e579644c-b007-48d7-b23e-dee9d367c0af with status ACTIVE [ 591.745888] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.746119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.746187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.746584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.746725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.746925] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.747160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.747265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.747472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.747579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.747805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.747918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.747987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.748412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.748412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.748412] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e579644c-b007-48d7-b23e-dee9d367c0af is going to be updated. [ 591.778508] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.778670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.778670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.778905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.779595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.779595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e579644c-b007-48d7-b23e-dee9d367c0af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.855902] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88e7a143-d5c4-4e09-8dc2-81b19d567fd2 [ 591.856175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.856314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.856393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.856650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.856767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.856873] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88e7a143-d5c4-4e09-8dc2-81b19d567fd2 already deleted. [ 591.856998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88e7a143-d5c4-4e09-8dc2-81b19d567fd2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.924882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.925061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.925128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.925354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.925441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.925648] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.925743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.925813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.925944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.926022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.926111] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b already deleted. [ 591.926191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.977497] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 in Status: SUCCESS [ 591.977497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.077634] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.077634] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.077634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.077634] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.078177] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.078177] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.078177] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.078177] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.078177] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.078343] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.102211] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.102388] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.102523] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.102699] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.103170] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-2b0027f9-96c1-43c9-949b-a23bad856dd0 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.103325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.103441] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.103791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.107020] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b0027f9-96c1-43c9-949b-a23bad856dd0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.219529] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.219529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.219529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.219797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.219900] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.219967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.220042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.220224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.220276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.220360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.220551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.220657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.220719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.220860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.220995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.221097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.221154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.221288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.221360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.221438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.221525] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.250521] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.354699] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a48c7a8-d335-432e-84f8-299d698936df req-8fe6e6cd-380b-4dd6-814f-2bcd5e6d4466 tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 592.354699] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 592.354699] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.354699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.354699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.355708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.355708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.356063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.356063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.356221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.356504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.356504] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.468413] env[65660]: INFO networking_nsxv3.common.synchronization [None req-7b8c248a-acf8-4ed7-8bcd-c035b0dc231c tempest-VolumesAssistedSnapshotsTest-18017522 tempest-VolumesAssistedSnapshotsTest-18017522-project-member] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_rules [ 592.468990] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_rules [ 592.469305] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.469427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.469492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.469729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.469811] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.606812] env[65660]: INFO networking_nsxv3.common.synchronization [None req-44925925-ecd8-4f0e-8228-efee01e5d830 None None] Enqueued Resource ID: ac7f65d2-5c14-40b8-842e-bf1c0e224441 with Priority: HIGHEST for action port [ 592.607345] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.607542] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.607635] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.607889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.608048] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.608193] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 2b0027f9-96c1-43c9-949b-a23bad856dd0 not found, creating... [ 592.608533] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.608691] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.609072] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.609311] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.609449] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.609726] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.609876] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.610021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.610194] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.610321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.610443] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 2b0027f9-96c1-43c9-949b-a23bad856dd0 is going to be created. [ 592.611844] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac7f65d2-5c14-40b8-842e-bf1c0e224441 with Priority: HIGHEST for action port [ 592.612310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac7f65d2-5c14-40b8-842e-bf1c0e224441 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.612310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac7f65d2-5c14-40b8-842e-bf1c0e224441" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.612310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac7f65d2-5c14-40b8-842e-bf1c0e224441" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.612544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac7f65d2-5c14-40b8-842e-bf1c0e224441" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.612544] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac7f65d2-5c14-40b8-842e-bf1c0e224441',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.631551] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.631813] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.632125] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.632218] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.632436] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.632639] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.724682] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f796b38-dca5-4730-a81c-cd9714b3ab8d: rpc.has_security_group_logging(os_id): False [ 592.752969] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.752969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.752969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.752969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.752969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.753304] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be created. [ 592.755814] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.755950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.756114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.756296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.756451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.756603] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.756684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.756816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.756973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.757055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.757248] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.757399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.757399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.757559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.757559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.757735] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.757923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.757923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.758078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.758078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.758227] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d is going to be created. [ 592.797680] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.797863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.797863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.798918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.798918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.809993] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: UNINITIALIZED for 2s [ 592.836572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.836725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.836995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.837116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.837294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.854292] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d in Status: IN_PROGRESS for 2s [ 592.858811] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.858981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.859057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.859288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.859389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.859504] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.859602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.859660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.859805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.859879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.859961] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb already deleted. [ 592.860052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.994039] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.994567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.994712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.994972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.995097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.995521] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c already deleted. [ 592.995661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.115952] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac7f65d2-5c14-40b8-842e-bf1c0e224441 [ 593.116690] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.116769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.116769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.117427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.117427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.117427] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac7f65d2-5c14-40b8-842e-bf1c0e224441 already deleted. [ 593.117427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac7f65d2-5c14-40b8-842e-bf1c0e224441" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.314413] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bdb16f8-c092-4458-8987-a5e007fd9d6e req-5840bed5-07cb-4275-ab69-997ba884bc27 service nova] Enqueued Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_rules [ 593.314713] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bdb16f8-c092-4458-8987-a5e007fd9d6e req-5840bed5-07cb-4275-ab69-997ba884bc27 service nova] Enqueued Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_members [ 593.314713] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bdb16f8-c092-4458-8987-a5e007fd9d6e req-5840bed5-07cb-4275-ab69-997ba884bc27 service nova] Enqueued Resource ID: 2b0027f9-96c1-43c9-949b-a23bad856dd0 with Priority: HIGHEST for action port [ 593.314942] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_rules [ 593.315084] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_members [ 593.315181] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b0027f9-96c1-43c9-949b-a23bad856dd0 with Priority: HIGHEST for action port [ 593.316446] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.316603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.316674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.317300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.317300] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.317905] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.318037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.318106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.318276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.318454] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.318526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.318565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.318707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.318801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.318874] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.320329] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b0027f9-96c1-43c9-949b-a23bad856dd0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.320710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.320710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.320710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.320815] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b0027f9-96c1-43c9-949b-a23bad856dd0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.824724] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.824938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.825829] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.826776] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b0027f9-96c1-43c9-949b-a23bad856dd0 with status ACTIVE [ 593.828649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.828649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.828649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.828649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.828649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.828649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.828887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.828887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.828948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.829008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.830807] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.830807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.830807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.830807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.830807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.830807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b0027f9-96c1-43c9-949b-a23bad856dd0 is going to be updated. [ 593.865063] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.865241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.867070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.867070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.867070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.867070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b0027f9-96c1-43c9-949b-a23bad856dd0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.868476] env[65660]: INFO networking_nsxv3.common.synchronization [None req-39b41d11-6119-42ae-aba8-5f3cabcdddb8 tempest-VolumesAssistedSnapshotsTest-18017522 tempest-VolumesAssistedSnapshotsTest-18017522-project-member] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_rules [ 593.868974] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_rules [ 593.869317] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.869400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.869515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.869636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.870424] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.923786] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.924018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.924123] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.924460] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.924721] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.924980] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.925076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.925733] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.925733] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.925842] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.927024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.927024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.927024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.927024] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.927024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.927024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.947122] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.948134] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.948327] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.948562] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.948852] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.949037] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.949241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.949578] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.949712] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ebc8dc-38c2-4a01-ad5a-80abd6e647bf',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.333332] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.391651] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.391837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.391889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.392099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.392196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.392320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c already deleted. [ 594.392379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.452435] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.452815] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.453008] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.453383] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.453605] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.453788] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 81ebc8dc-38c2-4a01-ad5a-80abd6e647bf not found, creating... [ 594.454103] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.454304] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.454436] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.454680] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.454814] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.459370] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.459370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.459370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.459370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.459370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.459370] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 81ebc8dc-38c2-4a01-ad5a-80abd6e647bf is going to be created. [ 594.482162] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.482387] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.482595] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.482993] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.483273] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.483620] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.821591] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.823147] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.823147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.823147] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.836451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.837217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.837489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.837880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.839183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.841150] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b is going to be created. [ 594.870870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.870870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.870870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.870870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.870870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.872807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d in Status: SUCCESS [ 594.873210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.886218] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b in Status: UNINITIALIZED for 2s [ 594.917234] env[65660]: INFO networking_nsxv3.common.synchronization [None req-38268e51-4e0f-419d-bba1-b684fe331f41 None None] Enqueued Resource ID: 83af2f57-b1ca-4f48-8aeb-ce02513e2089 with Priority: HIGHEST for action port [ 594.918227] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83af2f57-b1ca-4f48-8aeb-ce02513e2089 with Priority: HIGHEST for action port [ 594.918543] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-83af2f57-b1ca-4f48-8aeb-ce02513e2089 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.918744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83af2f57-b1ca-4f48-8aeb-ce02513e2089" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.919066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83af2f57-b1ca-4f48-8aeb-ce02513e2089" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.919514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83af2f57-b1ca-4f48-8aeb-ce02513e2089" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.920048] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83af2f57-b1ca-4f48-8aeb-ce02513e2089',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.106736] env[65660]: INFO networking_nsxv3.common.synchronization [req-a645d095-4c0a-4f0a-bcf2-fe629b56ca20 req-359f2671-c9ff-4881-b844-3fc7982716cc tempest-ServerExternalEventsTest-427583481 tempest-ServerExternalEventsTest-427583481-project-member] Enqueued Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_members [ 595.107425] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_members [ 595.107514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.107623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.107717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.107990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.108707] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.108799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.109424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.109424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.109424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.109424] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.182991] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a48c7a8-d335-432e-84f8-299d698936df req-d6af0f0c-56f3-4c49-b5c7-3d1e3b34d085 service nova] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_rules [ 595.183283] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a48c7a8-d335-432e-84f8-299d698936df req-d6af0f0c-56f3-4c49-b5c7-3d1e3b34d085 service nova] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 595.183517] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a48c7a8-d335-432e-84f8-299d698936df req-d6af0f0c-56f3-4c49-b5c7-3d1e3b34d085 service nova] Enqueued Resource ID: 81ebc8dc-38c2-4a01-ad5a-80abd6e647bf with Priority: HIGHEST for action port [ 595.184015] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_rules [ 595.184198] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 595.184341] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81ebc8dc-38c2-4a01-ad5a-80abd6e647bf with Priority: HIGHEST for action port [ 595.184716] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.184864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.184957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.185270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.185429] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.186399] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.186486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.186536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.186769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.186828] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.186901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.186962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.187229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.187229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.187311] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.188156] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.188599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.188718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.189548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.189548] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ebc8dc-38c2-4a01-ad5a-80abd6e647bf',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.252205] env[65660]: INFO networking_nsxv3.common.synchronization [None req-88cba5b9-6f5d-4d3b-b935-943829f4f51a None None] Enqueued Resource ID: 26158c89-eec3-484a-a286-42cb25658986 with Priority: HIGHEST for action port [ 595.252675] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26158c89-eec3-484a-a286-42cb25658986 with Priority: HIGHEST for action port [ 595.253202] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-26158c89-eec3-484a-a286-42cb25658986 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.253329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26158c89-eec3-484a-a286-42cb25658986" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.253426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26158c89-eec3-484a-a286-42cb25658986" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.254187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26158c89-eec3-484a-a286-42cb25658986" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.254303] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26158c89-eec3-484a-a286-42cb25658986',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.326176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.326360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.326427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.326627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.326797] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.327172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.327308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.327485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.327889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.327889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.327889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.327889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.328146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.328146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.328230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.328322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.328381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.328516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.328612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.328742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.328857] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.424791] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83af2f57-b1ca-4f48-8aeb-ce02513e2089 [ 595.424791] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.424791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.424791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.425291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.425291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.425291] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83af2f57-b1ca-4f48-8aeb-ce02513e2089 already deleted. [ 595.425291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83af2f57-b1ca-4f48-8aeb-ce02513e2089" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.505247] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.505822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.505985] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.506470] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.506533] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.506672] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.506783] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.506991] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.507139] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.507334] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.507442] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.507543] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.507644] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.507742] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.507838] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.507965] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.528377] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.528580] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.529117] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.529117] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.529452] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-e28deba1-10b6-40d8-b1fc-b52598bf2cee taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.529705] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.529844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.530248] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.530431] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e28deba1-10b6-40d8-b1fc-b52598bf2cee',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.612611] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.612769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.612848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.613177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.613177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.613384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.613481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.613533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.613690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.613765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.613845] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 already deleted. [ 595.613914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.691209] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.691476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.691698] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.692679] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81ebc8dc-38c2-4a01-ad5a-80abd6e647bf with status ACTIVE [ 595.692972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.693064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.693103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.693314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.693402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.693568] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.693662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.693718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.693866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.694134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.695181] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.695291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.695366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.695520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.695592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.695777] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81ebc8dc-38c2-4a01-ad5a-80abd6e647bf is going to be updated. [ 595.724808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.724978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.725059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.725302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.725455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.725628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81ebc8dc-38c2-4a01-ad5a-80abd6e647bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.758589] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26158c89-eec3-484a-a286-42cb25658986 [ 595.758589] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.758589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.758589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.758589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.758589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.758589] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26158c89-eec3-484a-a286-42cb25658986 already deleted. [ 595.758589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26158c89-eec3-484a-a286-42cb25658986" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.832557] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c5cc4f2-b09e-4802-8402-1b312af39573: rpc.has_security_group_logging(os_id): False [ 595.861137] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.861474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.861474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.861583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.861673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.861882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.861996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.862078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.862240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.862341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.862505] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.862611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.862692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.862818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.862901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.863130] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.863239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.863292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.863436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.863512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.863597] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be created. [ 595.960131] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.960340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.960340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.960611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.960821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.971702] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: IN_PROGRESS for 2s [ 596.032837] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.033109] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.034346] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.034346] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.034346] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.034346] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port e28deba1-10b6-40d8-b1fc-b52598bf2cee not found, creating... [ 596.034346] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.034346] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.034604] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.034604] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.034789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.034994] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.035229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.035305] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.035452] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.035578] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.035716] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: e28deba1-10b6-40d8-b1fc-b52598bf2cee is going to be created. [ 596.064580] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.064822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.064902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.065222] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.065451] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.065670] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.198162] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.678181] env[65660]: INFO networking_nsxv3.common.synchronization [None req-77fadd11-06c8-40f7-b5ad-3169a5bc6009 None None] Enqueued Resource ID: 1dd55439-b60a-4868-b6c0-2ef59e9e838a with Priority: HIGHEST for action port [ 596.678770] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd55439-b60a-4868-b6c0-2ef59e9e838a with Priority: HIGHEST for action port [ 596.679376] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dd55439-b60a-4868-b6c0-2ef59e9e838a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.679553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dd55439-b60a-4868-b6c0-2ef59e9e838a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.679626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dd55439-b60a-4868-b6c0-2ef59e9e838a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.680076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dd55439-b60a-4868-b6c0-2ef59e9e838a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.680141] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dd55439-b60a-4868-b6c0-2ef59e9e838a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.700802] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.700990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.701052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.701729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.701729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.701729] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be created. [ 596.726072] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.726263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.726313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.726590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.726676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.737493] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: UNINITIALIZED for 2s [ 596.748648] env[65660]: INFO networking_nsxv3.common.synchronization [req-a645d095-4c0a-4f0a-bcf2-fe629b56ca20 req-31858440-c7ba-4e38-956b-a7c56dfe2883 service nova] Enqueued Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_rules [ 596.748648] env[65660]: INFO networking_nsxv3.common.synchronization [req-a645d095-4c0a-4f0a-bcf2-fe629b56ca20 req-31858440-c7ba-4e38-956b-a7c56dfe2883 service nova] Enqueued Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_members [ 596.748648] env[65660]: INFO networking_nsxv3.common.synchronization [req-a645d095-4c0a-4f0a-bcf2-fe629b56ca20 req-31858440-c7ba-4e38-956b-a7c56dfe2883 service nova] Enqueued Resource ID: e28deba1-10b6-40d8-b1fc-b52598bf2cee with Priority: HIGHEST for action port [ 596.748817] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_rules [ 596.748817] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_members [ 596.748929] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e28deba1-10b6-40d8-b1fc-b52598bf2cee with Priority: HIGHEST for action port [ 596.749988] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.749988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.749988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.750379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.750467] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.751364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.751553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.751553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.751743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.751950] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.752065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.752126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.752273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.752360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.752498] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.753263] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e28deba1-10b6-40d8-b1fc-b52598bf2cee taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.753375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.753472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.753584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.753658] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e28deba1-10b6-40d8-b1fc-b52598bf2cee',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.898819] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b in Status: SUCCESS [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.898819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.898819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.898819] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.181786] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dd55439-b60a-4868-b6c0-2ef59e9e838a [ 597.182198] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.182473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.182656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.182991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.183198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.184636] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dd55439-b60a-4868-b6c0-2ef59e9e838a already deleted. [ 597.184636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dd55439-b60a-4868-b6c0-2ef59e9e838a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.258021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.258021] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.258021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e28deba1-10b6-40d8-b1fc-b52598bf2cee with status ACTIVE [ 597.258021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.258021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.258021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.258898] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.259097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.259221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.259399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.259514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.259639] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e28deba1-10b6-40d8-b1fc-b52598bf2cee is going to be updated. [ 597.309434] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.309711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.309841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.310217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.310305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.310475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e28deba1-10b6-40d8-b1fc-b52598bf2cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.401639] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.402344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.402344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.402770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.404243] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.404407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.404453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.404611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.404703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.404793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.404952] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.405058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.405109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.405258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.405438] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.405492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.405567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.405683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.405743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.405810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.405912] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.763233] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.911363] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f87a553-f0af-4b3c-a4c8-027ffa03572b: rpc.has_security_group_logging(os_id): False [ 597.931821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.932310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.932310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.932461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.932547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.932805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.932961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.933050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.933250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.933349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.933668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.933785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.933785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.935081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.935221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.935448] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.935564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.935637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.935807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.935907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.936008] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b is going to be created. [ 597.985558] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 597.985899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.016530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.016721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.016763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.016960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.017151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.040733] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b in Status: IN_PROGRESS for 2s [ 598.267547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.267547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.267667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.268028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.268325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.268584] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 is going to be created. [ 598.296769] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.296918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.297048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.297234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.297404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.312106] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 in Status: UNINITIALIZED for 2s [ 598.747324] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 598.747626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.748098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.748098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.748264] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.748264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.748393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.748583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.748583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.748795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.748795] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.076880] env[65660]: INFO networking_nsxv3.common.synchronization [None req-96fb73d4-1eb1-489c-8d0a-f66262b76c9a None None] Enqueued Resource ID: 50b1e1ee-78c6-48e3-838b-d3393c47891e with Priority: HIGHEST for action port [ 599.077467] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b1e1ee-78c6-48e3-838b-d3393c47891e with Priority: HIGHEST for action port [ 599.077775] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b1e1ee-78c6-48e3-838b-d3393c47891e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.077898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b1e1ee-78c6-48e3-838b-d3393c47891e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.077965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b1e1ee-78c6-48e3-838b-d3393c47891e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.081079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b1e1ee-78c6-48e3-838b-d3393c47891e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.081079] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b1e1ee-78c6-48e3-838b-d3393c47891e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.257134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.257134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.257134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.257134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.257134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.257553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.257553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.257553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.257553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.257702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.258393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.258393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.258393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.258393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.258393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.258393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.258393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.258851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.258851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.258851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.258851] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.580586] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50b1e1ee-78c6-48e3-838b-d3393c47891e [ 599.580586] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.580935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.580935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.581083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.581159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.581545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50b1e1ee-78c6-48e3-838b-d3393c47891e already deleted. [ 599.581545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b1e1ee-78c6-48e3-838b-d3393c47891e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.766762] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bb1aae9-5e28-4517-b1d1-0a8a052663cb: rpc.has_security_group_logging(os_id): False [ 599.795575] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.795765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.795877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.796342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.796342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.796515] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.796515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.796660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.796797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.796882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.797414] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.797414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.797414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.797414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.797668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.797720] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.797789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.797972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.798105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.798292] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be created. [ 599.889558] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.889712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.889825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.890513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.890513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.903557] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 599.985301] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b35e54a5-bbab-4308-a3fc-7013bb2885f1 None None] Enqueued Resource ID: e4f50312-55db-4f97-92af-f539013e9a27 with Priority: HIGHEST for action port [ 599.985934] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4f50312-55db-4f97-92af-f539013e9a27 with Priority: HIGHEST for action port [ 599.986462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4f50312-55db-4f97-92af-f539013e9a27 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.986462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4f50312-55db-4f97-92af-f539013e9a27" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.986601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4f50312-55db-4f97-92af-f539013e9a27" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.986781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4f50312-55db-4f97-92af-f539013e9a27" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.986875] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4f50312-55db-4f97-92af-f539013e9a27',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.056359] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b in Status: SUCCESS [ 600.056359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.338443] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 in Status: SUCCESS [ 600.338443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.338443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.338443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.338443] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.338443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.339373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.339895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.343074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.343074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.343074] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.490576] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4f50312-55db-4f97-92af-f539013e9a27 [ 600.490839] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.491045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.491136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.491461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.491587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.491865] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4f50312-55db-4f97-92af-f539013e9a27 already deleted. [ 600.491865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4f50312-55db-4f97-92af-f539013e9a27" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.848149] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.848149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.848149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.848445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.848445] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.848558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.848558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.848691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.849076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.849076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.849076] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.852069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.852069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.852069] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.353877] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c9e0656-5fea-404b-bf7f-6b1310cebf25: rpc.has_security_group_logging(os_id): False [ 601.378333] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.378509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.378560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.378974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.379132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.379396] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.379563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.379719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.379873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.380316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.380316] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.380414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.380453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.380787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.381385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.381385] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.381385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.381578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.381716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.381967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.381967] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 is going to be created. [ 601.446029] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.446173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.446274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.446509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.447468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.463015] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 in Status: IN_PROGRESS for 2s [ 601.926402] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 601.926640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.763423] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b680201a-5086-4357-8231-7f84e34a5f01 None None] Enqueued Resource ID: 6780a1ce-d6eb-4872-9cd6-4ac346028903 with Priority: HIGHEST for action port [ 602.764059] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6780a1ce-d6eb-4872-9cd6-4ac346028903 with Priority: HIGHEST for action port [ 602.764428] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6780a1ce-d6eb-4872-9cd6-4ac346028903 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.764572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6780a1ce-d6eb-4872-9cd6-4ac346028903" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.764638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6780a1ce-d6eb-4872-9cd6-4ac346028903" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.764938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6780a1ce-d6eb-4872-9cd6-4ac346028903" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.765041] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6780a1ce-d6eb-4872-9cd6-4ac346028903',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.253731] env[65660]: INFO networking_nsxv3.common.synchronization [req-507c8cf5-c1bb-48c3-9ccb-72f3bc079dee req-4b1e1d1c-d348-49f1-ba2f-4dda2fa06a94 tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: c8c88687-02d5-4c4d-9d8d-7814b5173a78 with Priority: HIGHEST for action security_group_rules [ 603.254375] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c88687-02d5-4c4d-9d8d-7814b5173a78 with Priority: HIGHEST for action security_group_rules [ 603.254788] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8c88687-02d5-4c4d-9d8d-7814b5173a78 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.254874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8c88687-02d5-4c4d-9d8d-7814b5173a78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.254920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8c88687-02d5-4c4d-9d8d-7814b5173a78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.255482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8c88687-02d5-4c4d-9d8d-7814b5173a78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.255579] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8c88687-02d5-4c4d-9d8d-7814b5173a78',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.267179] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6780a1ce-d6eb-4872-9cd6-4ac346028903 [ 603.267494] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.267592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.267690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.267901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.267998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.269171] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6780a1ce-d6eb-4872-9cd6-4ac346028903 already deleted. [ 603.269341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6780a1ce-d6eb-4872-9cd6-4ac346028903" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.425181] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ab4fce36-5019-4585-9303-b9f43edcd87b None None] Enqueued Resource ID: b60487d2-3ac0-443c-b407-769074cb2ec9 with Priority: HIGHEST for action port [ 603.425696] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60487d2-3ac0-443c-b407-769074cb2ec9 with Priority: HIGHEST for action port [ 603.426168] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60487d2-3ac0-443c-b407-769074cb2ec9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.426168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60487d2-3ac0-443c-b407-769074cb2ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.426643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60487d2-3ac0-443c-b407-769074cb2ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.427030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60487d2-3ac0-443c-b407-769074cb2ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.427102] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60487d2-3ac0-443c-b407-769074cb2ec9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.478167] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 in Status: SUCCESS [ 603.479361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.550133] env[65660]: INFO networking_nsxv3.common.synchronization [req-58691a60-0986-4528-a172-ba192991f131 req-092b0f24-bca7-4dff-b669-5c0ac9797f08 tempest-InstanceActionsTestJSON-396381560 tempest-InstanceActionsTestJSON-396381560-project-member] Enqueued Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_members [ 603.550133] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_members [ 603.550133] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.550133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.550133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.550133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.550859] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.551165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.551358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.551639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.552100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.552344] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.781136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.781877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.782135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.782712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.783350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.783605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8c88687-02d5-4c4d-9d8d-7814b5173a78 already deleted. [ 603.783835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8c88687-02d5-4c4d-9d8d-7814b5173a78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.931254] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b60487d2-3ac0-443c-b407-769074cb2ec9 [ 603.932070] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.932070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.932070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.935886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.935886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.935991] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b60487d2-3ac0-443c-b407-769074cb2ec9 already deleted. [ 603.936062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60487d2-3ac0-443c-b407-769074cb2ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.017960] env[65660]: INFO networking_nsxv3.common.synchronization [None req-30414a2b-47a5-455e-a420-28e364683df0 None None] Enqueued Resource ID: 39572568-36fc-462b-ad5c-774a941a88a0 with Priority: HIGHEST for action port [ 604.018581] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39572568-36fc-462b-ad5c-774a941a88a0 with Priority: HIGHEST for action port [ 604.018954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-39572568-36fc-462b-ad5c-774a941a88a0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.019452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39572568-36fc-462b-ad5c-774a941a88a0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.019452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39572568-36fc-462b-ad5c-774a941a88a0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.019717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39572568-36fc-462b-ad5c-774a941a88a0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.019717] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39572568-36fc-462b-ad5c-774a941a88a0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.056562] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.056562] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.056562] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a already deleted. [ 604.056562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.522152] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39572568-36fc-462b-ad5c-774a941a88a0 [ 604.523046] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.523046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.523046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.523046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.523046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.523046] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39572568-36fc-462b-ad5c-774a941a88a0 already deleted. [ 604.523251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39572568-36fc-462b-ad5c-774a941a88a0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.823527] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-6 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.823527] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.823527] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.823979] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.824218] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.824408] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.824561] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.824845] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.825059] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.825365] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.825493] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.825598] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.825699] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.825805] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.825902] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.826050] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.851784] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.852055] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.852198] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.852391] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.852709] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.852883] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.853054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.853349] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.853503] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1827bd0f-c4c0-457a-8fb1-ce1de111f6dd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.020310] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b36eda63-3780-43c5-b60d-46faf4ace9f7 None None] Enqueued Resource ID: dd03bd4a-fa7b-4f58-97b6-2402b3b454f5 with Priority: HIGHEST for action port [ 605.020310] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd03bd4a-fa7b-4f58-97b6-2402b3b454f5 with Priority: HIGHEST for action port [ 605.020310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd03bd4a-fa7b-4f58-97b6-2402b3b454f5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.021078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd03bd4a-fa7b-4f58-97b6-2402b3b454f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.021257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd03bd4a-fa7b-4f58-97b6-2402b3b454f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.021766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd03bd4a-fa7b-4f58-97b6-2402b3b454f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.022051] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd03bd4a-fa7b-4f58-97b6-2402b3b454f5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.360303] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.360303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.360303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.360303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.360303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.360303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 1827bd0f-c4c0-457a-8fb1-ce1de111f6dd not found, creating... [ 605.360303] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.360303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.361324] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.361609] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.361781] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.362129] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.362297] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.362406] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.362628] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.362757] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.362899] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 1827bd0f-c4c0-457a-8fb1-ce1de111f6dd is going to be created. [ 605.399035] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.399981] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.400451] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.400786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.401117] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.401379] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.515217] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5f5238bf-83ed-4999-af41-5f1f07b34695 None None] Enqueued Resource ID: d16a1768-75da-4357-830e-b3b4a2b74526 with Priority: HIGHEST for action port [ 605.518781] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16a1768-75da-4357-830e-b3b4a2b74526 with Priority: HIGHEST for action port [ 605.519447] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16a1768-75da-4357-830e-b3b4a2b74526 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.522174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16a1768-75da-4357-830e-b3b4a2b74526" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.522174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16a1768-75da-4357-830e-b3b4a2b74526" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.522174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16a1768-75da-4357-830e-b3b4a2b74526" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.522174] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16a1768-75da-4357-830e-b3b4a2b74526',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.525215] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd03bd4a-fa7b-4f58-97b6-2402b3b454f5 [ 605.525550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.527054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.527054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.527054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.527054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.527054] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd03bd4a-fa7b-4f58-97b6-2402b3b454f5 already deleted. [ 605.527054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd03bd4a-fa7b-4f58-97b6-2402b3b454f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.025682] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d16a1768-75da-4357-830e-b3b4a2b74526 [ 606.026019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.026288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.026288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.026525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.026709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.026709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d16a1768-75da-4357-830e-b3b4a2b74526 already deleted. [ 606.026886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16a1768-75da-4357-830e-b3b4a2b74526" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.194883] env[65660]: INFO networking_nsxv3.common.synchronization [req-58691a60-0986-4528-a172-ba192991f131 req-05378497-66d3-4892-ba02-5072575dbf62 service nova] Enqueued Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_rules [ 606.196962] env[65660]: INFO networking_nsxv3.common.synchronization [req-58691a60-0986-4528-a172-ba192991f131 req-05378497-66d3-4892-ba02-5072575dbf62 service nova] Enqueued Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_members [ 606.199569] env[65660]: INFO networking_nsxv3.common.synchronization [req-58691a60-0986-4528-a172-ba192991f131 req-05378497-66d3-4892-ba02-5072575dbf62 service nova] Enqueued Resource ID: 1827bd0f-c4c0-457a-8fb1-ce1de111f6dd with Priority: HIGHEST for action port [ 606.200398] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_rules [ 606.201197] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_members [ 606.201197] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1827bd0f-c4c0-457a-8fb1-ce1de111f6dd with Priority: HIGHEST for action port [ 606.201197] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.201197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.201899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.201899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.201899] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.204089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.204235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.204296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.204731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.204731] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.204915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.204915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.205035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.205035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.205137] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.206518] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.206518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.206518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.206518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.206518] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1827bd0f-c4c0-457a-8fb1-ce1de111f6dd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.301708] env[65660]: INFO networking_nsxv3.common.synchronization [None req-4018d4b2-5722-474a-a819-50b895f4605b None None] Enqueued Resource ID: 3dc4e922-925a-48d1-b5d6-478480338774 with Priority: HIGHEST for action port [ 606.301951] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc4e922-925a-48d1-b5d6-478480338774 with Priority: HIGHEST for action port [ 606.302279] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc4e922-925a-48d1-b5d6-478480338774 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.302394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc4e922-925a-48d1-b5d6-478480338774" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.304161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc4e922-925a-48d1-b5d6-478480338774" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.304161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc4e922-925a-48d1-b5d6-478480338774" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.304161] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc4e922-925a-48d1-b5d6-478480338774',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.505368] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb5da03e-02af-44ff-b7b9-21e672ffa64b req-5419e370-3c2f-424d-92a4-d50aa90aea1d tempest-VolumesAssistedSnapshotsTest-18017522 tempest-VolumesAssistedSnapshotsTest-18017522-project-member] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_members [ 606.506391] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_members [ 606.506700] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.506908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.506966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.507298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.507542] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.507673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.507760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.508219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.508219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.508316] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.704741] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.704965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.709395] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1827bd0f-c4c0-457a-8fb1-ce1de111f6dd with status ACTIVE [ 606.709603] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.709736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.709814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.710531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.710531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.710531] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.710531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.710531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.710801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.710801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.710937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.711022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.711076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.711206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.711276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.711356] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1827bd0f-c4c0-457a-8fb1-ce1de111f6dd is going to be updated. [ 606.712520] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.739866] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.740083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.740083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.740298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.740439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.740601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1827bd0f-c4c0-457a-8fb1-ce1de111f6dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.807432] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dc4e922-925a-48d1-b5d6-478480338774 [ 606.807765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.807955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.808240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.808317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.808492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.808556] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dc4e922-925a-48d1-b5d6-478480338774 already deleted. [ 606.808706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc4e922-925a-48d1-b5d6-478480338774" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.856560] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.856560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.856560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.857037] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.857214] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.857441] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.857620] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.858525] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.858525] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.858525] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.858877] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.859016] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.859341] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.859490] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.859907] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.860441] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.890323] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.890494] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 606.891209] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.891209] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.891351] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-18d4c912-f92b-42c0-8bba-875e850c9ded taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.891435] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.891654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.891920] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.892076] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d4c912-f92b-42c0-8bba-875e850c9ded',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.011411] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.011683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.011830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.012170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.012318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.012546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.012655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.012709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.012873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.012952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.013078] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c already deleted. [ 607.013167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.219979] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.395958] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.399025] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 18d4c912-f92b-42c0-8bba-875e850c9ded not found, creating... [ 607.399025] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.399025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.399565] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.399565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.399565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.401519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.401832] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.402224] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 18d4c912-f92b-42c0-8bba-875e850c9ded is going to be created. [ 607.431437] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.437321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.437321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.437321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.437321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.437321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.519384] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d6eb4d2a-839b-40f0-ad1f-1429c9b6ce15 None None] Enqueued Resource ID: 3ccd4481-2142-4500-a621-872f5bfeaea9 with Priority: HIGHEST for action port [ 607.520503] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ccd4481-2142-4500-a621-872f5bfeaea9 with Priority: HIGHEST for action port [ 607.521080] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ccd4481-2142-4500-a621-872f5bfeaea9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.521935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ccd4481-2142-4500-a621-872f5bfeaea9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.521935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ccd4481-2142-4500-a621-872f5bfeaea9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.521935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ccd4481-2142-4500-a621-872f5bfeaea9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.521935] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ccd4481-2142-4500-a621-872f5bfeaea9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.724256] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.724256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.724256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.724256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.724256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.724256] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a is going to be created. [ 607.757181] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.757363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.757414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.757621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.757783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.773550] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a in Status: UNINITIALIZED for 2s [ 608.025202] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ccd4481-2142-4500-a621-872f5bfeaea9 [ 608.027670] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.027865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.027919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.028160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.028265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.028365] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ccd4481-2142-4500-a621-872f5bfeaea9 already deleted. [ 608.028475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ccd4481-2142-4500-a621-872f5bfeaea9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.187935] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb5da03e-02af-44ff-b7b9-21e672ffa64b req-506a5569-161b-4cf0-b361-e0cb48f6d918 service nova] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_rules [ 608.187935] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb5da03e-02af-44ff-b7b9-21e672ffa64b req-506a5569-161b-4cf0-b361-e0cb48f6d918 service nova] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_members [ 608.187935] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb5da03e-02af-44ff-b7b9-21e672ffa64b req-506a5569-161b-4cf0-b361-e0cb48f6d918 service nova] Enqueued Resource ID: 18d4c912-f92b-42c0-8bba-875e850c9ded with Priority: HIGHEST for action port [ 608.188223] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_rules [ 608.188398] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_members [ 608.188549] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d4c912-f92b-42c0-8bba-875e850c9ded with Priority: HIGHEST for action port [ 608.188901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.189065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.189145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.189495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.189495] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.190682] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.190859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.190941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.191232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.193233] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.193370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.193457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.193683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.193794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.193924] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.194971] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d4c912-f92b-42c0-8bba-875e850c9ded taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.195099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.195196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.195406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.195505] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d4c912-f92b-42c0-8bba-875e850c9ded',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.697956] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.699240] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.699336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.701040] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18d4c912-f92b-42c0-8bba-875e850c9ded with status ACTIVE [ 608.701306] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.701438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.701506] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.704891] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.704891] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.704891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.704891] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18d4c912-f92b-42c0-8bba-875e850c9ded is going to be updated. [ 608.727947] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.728130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.728207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.728426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.728566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.728748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d4c912-f92b-42c0-8bba-875e850c9ded" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.202161] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.706244] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.706625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.706625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.706715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.706798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.706971] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c is going to be created. [ 609.730574] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.730768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.730768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.730974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.731149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.744836] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c in Status: UNINITIALIZED for 2s [ 609.787823] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a in Status: SUCCESS [ 609.788138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.788503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.788591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.788856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.789030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.789146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.789339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.789518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.789599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.789706] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.296028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.296028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.296028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.296028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.296028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.296835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.296835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.296835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.297177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.297517] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.800412] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a: rpc.has_security_group_logging(os_id): False [ 610.821804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.822091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.822270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.822358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.822556] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.822777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.822931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.822962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823352] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823724] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.824071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.824183] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a is going to be created. [ 610.916354] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.916612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.916612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.916841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.917134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.939485] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a in Status: IN_PROGRESS for 2s [ 611.238342] env[65660]: INFO networking_nsxv3.common.synchronization [req-3ccde458-beec-467a-9bac-23197b825d5e req-4a7bc38e-d447-4835-99f3-2e486cae689f tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: 840f54e7-a8c6-496f-9748-53385e2a842b with Priority: HIGHEST for action security_group_rules [ 611.238342] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 840f54e7-a8c6-496f-9748-53385e2a842b with Priority: HIGHEST for action security_group_rules [ 611.239234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-840f54e7-a8c6-496f-9748-53385e2a842b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.239637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-840f54e7-a8c6-496f-9748-53385e2a842b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.239844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-840f54e7-a8c6-496f-9748-53385e2a842b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.240410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-840f54e7-a8c6-496f-9748-53385e2a842b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.240707] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('840f54e7-a8c6-496f-9748-53385e2a842b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.758112] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c in Status: SUCCESS [ 611.758364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.758535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.758762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.758998] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.759147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.759215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.759389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.759498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.759560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.759637] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.762679] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.762844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.762905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.763131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.763271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.763375] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 840f54e7-a8c6-496f-9748-53385e2a842b already deleted. [ 611.763488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-840f54e7-a8c6-496f-9748-53385e2a842b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.263319] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.621141] env[65660]: INFO networking_nsxv3.common.synchronization [req-d75678fb-77a1-41f5-bbd4-ab3409dc886d req-f5a6e4c0-f43d-40ea-8a7f-e075da6e7126 tempest-VolumesAdminNegativeTest-1465503759 tempest-VolumesAdminNegativeTest-1465503759-project-member] Enqueued Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_members [ 612.621141] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_members [ 612.621141] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.621531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.621814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.622295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.622632] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.622961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.624645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.624645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.624645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.624645] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.652236] env[65660]: INFO networking_nsxv3.common.synchronization [req-06c742b6-1a03-4dc2-957a-70ec0f77a103 req-81e88892-885e-4911-998e-8cc5d573b571 tempest-DeleteServersAdminTestJSON-165218470 tempest-DeleteServersAdminTestJSON-165218470-project-admin] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 612.653870] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 612.653870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.653870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.653870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.653870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.653870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.653870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.653870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.654200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.654200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.654200] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.766525] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a8aaa9b-7467-48c3-bfb1-e630aeec084c: rpc.has_security_group_logging(os_id): False [ 612.791638] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.791638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.792081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.792480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.792633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.792902] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.793032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.793095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.793316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.793437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.793494] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c is going to be created. [ 612.861412] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.861743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.861743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.862189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.862332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.882237] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c in Status: IN_PROGRESS for 2s [ 612.976017] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a in Status: SUCCESS [ 612.976367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.037261] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.037261] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-146" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.037261] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-146" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.037261] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-146" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.037471] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.037957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.037957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.038528] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.038528] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.038528] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.038967] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.038967] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.039173] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.039363] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.039528] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.039697] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.059151] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.059346] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.059483] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.059693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-146" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.060485] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.060485] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.060718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.061775] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.062150] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c08851b-e7c4-46f3-8d9e-ce1ecbc59618',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.126568] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.126742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.126960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.127426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.127583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.128125] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.128304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.128501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.128736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.128867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.129032] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 already deleted. [ 613.129185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.157298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.157523] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.157647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.157968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.158142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.158366] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.158473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.158538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.158699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.158781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.158868] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be updated. [ 613.213570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.213819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.213819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.214025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.214454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.224538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: IN_PROGRESS for 2s [ 613.566281] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.566806] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.566806] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.567073] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.567297] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.567465] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 not found, creating... [ 613.567735] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.567910] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.568066] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.568310] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.568451] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.568736] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.568894] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.569019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.569278] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.569400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.569602] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 is going to be created. [ 613.592489] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.593232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.593232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.593682] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.593900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.594246] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.607035] env[65660]: INFO networking_nsxv3.common.synchronization [req-8ca71393-7f66-49c8-9d0d-29f1a2203ea7 req-c38847c5-c192-4bac-8ee1-824d1d227dbf tempest-ImagesNegativeTestJSON-453915284 tempest-ImagesNegativeTestJSON-453915284-project-member] Enqueued Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_members [ 613.607708] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 with Priority: HIGHEST for action security_group_members [ 613.611784] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e668c0d3-6bc9-4aa1-941b-9707aedef834 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.611784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.612063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.612204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.612464] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.612610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.613441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.613441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.613441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.613441] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e668c0d3-6bc9-4aa1-941b-9707aedef834',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.118745] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.118986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.118986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.119449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.119449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.119951] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.119951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.119951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.119951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.119951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.120198] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 is going to be updated. [ 614.152049] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.152283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.152283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.152377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.152489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.162943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 in Status: IN_PROGRESS for 2s [ 614.270163] env[65660]: INFO networking_nsxv3.common.synchronization [None req-135506fd-fab2-4cbe-b146-91b794de8949 tempest-ServersWithSpecificFlavorTestJSON-1002304921 tempest-ServersWithSpecificFlavorTestJSON-1002304921-project-member] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 614.271405] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 614.271491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.271606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.271695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.272030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.272210] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.310401] env[65660]: INFO networking_nsxv3.common.synchronization [req-d75678fb-77a1-41f5-bbd4-ab3409dc886d req-3b01a498-c57c-435e-9982-28a8f43b27da service nova] Enqueued Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_rules [ 614.310998] env[65660]: INFO networking_nsxv3.common.synchronization [req-d75678fb-77a1-41f5-bbd4-ab3409dc886d req-3b01a498-c57c-435e-9982-28a8f43b27da service nova] Enqueued Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_members [ 614.310998] env[65660]: INFO networking_nsxv3.common.synchronization [req-d75678fb-77a1-41f5-bbd4-ab3409dc886d req-3b01a498-c57c-435e-9982-28a8f43b27da service nova] Enqueued Resource ID: 6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 with Priority: HIGHEST for action port [ 614.313730] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_rules [ 614.313730] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_members [ 614.313730] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 with Priority: HIGHEST for action port [ 614.313730] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.313730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.313730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.313730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.313730] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.320267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.320267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.320267] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.320267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.320267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.320267] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c08851b-e7c4-46f3-8d9e-ce1ecbc59618',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.402405] env[65660]: INFO networking_nsxv3.common.synchronization [None req-158f493a-2272-4a0f-a4fc-7eabc0af6586 tempest-ServersWithSpecificFlavorTestJSON-1002304921 tempest-ServersWithSpecificFlavorTestJSON-1002304921-project-member] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 614.404185] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 614.404185] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.404185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.667417] env[65660]: INFO networking_nsxv3.common.synchronization [req-d2059164-1786-404e-b4f1-4ba62a5c6373 req-b7f3e3d4-ed88-4875-8e63-0d73f8443163 tempest-ServerDiagnosticsNegativeTest-1273104442 tempest-ServerDiagnosticsNegativeTest-1273104442-project-member] Enqueued Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_members [ 614.667417] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGHEST for action security_group_members [ 614.667417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.667417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.667417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.667417] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.795838] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.796276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.796390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.796648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.796913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.796913] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 already deleted. [ 614.797167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.797479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.797672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.797758] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.823169] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.823322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.824016] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.825228] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 with status ACTIVE [ 614.825436] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.825566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.825630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.825849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.825934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.826137] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.826233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.826308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.826455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.826539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.826735] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.826827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.826887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.827035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.827119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.827198] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c08851b-e7c4-46f3-8d9e-ce1ecbc59618 is going to be updated. [ 614.850631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.852033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.852033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.852033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.852033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.852033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c08851b-e7c4-46f3-8d9e-ce1ecbc59618" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.896633] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c in Status: SUCCESS [ 614.896880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.164782] env[65660]: INFO networking_nsxv3.common.synchronization [req-8c5377bc-1219-48aa-b924-9e11ece66b7a req-020ee0cb-d5d9-416b-8248-77d302b52390 tempest-ServersTestBootFromVolume-443678150 tempest-ServersTestBootFromVolume-443678150-project-member] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_members [ 615.165543] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_members [ 615.165757] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.165874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.165874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.167619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.167756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.167926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.168061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.168298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.168398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.168480] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.169765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.169927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.170045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.170152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.170240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.170418] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.170513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.170573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.170718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.170791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.170907] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d is going to be updated. [ 615.205950] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.206135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.206227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.206422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.206585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.217731] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d in Status: IN_PROGRESS for 2s [ 615.235641] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 615.237198] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 deletion is rescheduled due to dependency. [ 615.237650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.319750] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.319750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.320280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.320280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.320280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.320280] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 already deleted. [ 615.320280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.325748] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.512839] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-212 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.513367] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-212" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.513630] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-212" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.516559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-212" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.516559] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.516559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.516559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.516559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.516559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.516559] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.516559] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.516559] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.516559] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.516559] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.517104] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.517104] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.539038] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.539354] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.539567] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.540243] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-212" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.540778] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-168708e9-eb81-41d2-980f-38b87d38f3bf taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.541126] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.541327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.541891] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.542149] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('168708e9-eb81-41d2-980f-38b87d38f3bf',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.674492] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.676674] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.676674] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 already deleted. [ 615.676674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.828653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.828903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.829021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.829288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.829420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.829540] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 is going to be created. [ 615.856482] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.856642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.856703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.856932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.857102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.868497] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 in Status: UNINITIALIZED for 2s [ 616.046272] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.046498] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.046620] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.046923] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.047091] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.047255] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 168708e9-eb81-41d2-980f-38b87d38f3bf not found, creating... [ 616.047518] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.047668] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.047779] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.048026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.048168] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.048468] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.048621] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.048741] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.049041] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.049235] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.049396] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 168708e9-eb81-41d2-980f-38b87d38f3bf is going to be created. [ 616.080248] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.080493] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.080667] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.081124] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.081410] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.081639] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.180031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 in Status: SUCCESS [ 616.180031] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e668c0d3-6bc9-4aa1-941b-9707aedef834 deletion is rescheduled due to dependency. [ 616.180031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e668c0d3-6bc9-4aa1-941b-9707aedef834" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.515795] env[65660]: INFO networking_nsxv3.common.synchronization [req-fccb0425-c814-4de3-a9cb-64f1396bb05c req-b5422f39-7d06-4d61-9ce7-1f4e52570228 tempest-ServerDiagnosticsTest-1890152622 tempest-ServerDiagnosticsTest-1890152622-project-member] Enqueued Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_members [ 616.516389] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGHEST for action security_group_members [ 616.516704] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.516831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.516902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.518901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.518901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.519085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.519085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.519263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.519347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.519453] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.869116] env[65660]: INFO networking_nsxv3.common.synchronization [req-8c5377bc-1219-48aa-b924-9e11ece66b7a req-f12560b8-b40d-46f5-a2ba-767606050df2 service nova] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_rules [ 616.869596] env[65660]: INFO networking_nsxv3.common.synchronization [req-8c5377bc-1219-48aa-b924-9e11ece66b7a req-f12560b8-b40d-46f5-a2ba-767606050df2 service nova] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_members [ 616.869723] env[65660]: INFO networking_nsxv3.common.synchronization [req-8c5377bc-1219-48aa-b924-9e11ece66b7a req-f12560b8-b40d-46f5-a2ba-767606050df2 service nova] Enqueued Resource ID: 168708e9-eb81-41d2-980f-38b87d38f3bf with Priority: HIGHEST for action port [ 616.870649] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_rules [ 616.870932] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_members [ 616.871150] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168708e9-eb81-41d2-980f-38b87d38f3bf with Priority: HIGHEST for action port [ 616.871608] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.871871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.871974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.872402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.872534] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.873756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.874194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.874194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.875407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.875407] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.875407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.875407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.875407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.875407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.875407] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.878444] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-168708e9-eb81-41d2-980f-38b87d38f3bf taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.880595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.880595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.880595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.880595] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('168708e9-eb81-41d2-980f-38b87d38f3bf',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.022765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.022765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.022765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.022765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.023174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.024478] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.024478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.024478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.024478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.024478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.024478] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b is going to be updated. [ 617.063824] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.064095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.064095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.064261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.064404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.076127] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b in Status: IN_PROGRESS for 2s [ 617.156724] env[65660]: INFO networking_nsxv3.common.synchronization [req-13574bfe-cfc6-44cc-9046-9fb093cf7261 req-88168dd3-3cdc-4977-b10e-21f80e034a34 tempest-ServerExternalEventsTest-427583481 tempest-ServerExternalEventsTest-427583481-project-member] Enqueued Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_members [ 617.157313] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGHEST for action security_group_members [ 617.157688] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.157819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.157894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.158270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.158374] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.158465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.158528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.158684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.158788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.158886] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.231531] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d in Status: SUCCESS [ 617.231531] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d deletion is rescheduled due to dependency. [ 617.231531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.381353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.381589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.381852] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.382724] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 168708e9-eb81-41d2-980f-38b87d38f3bf with status ACTIVE [ 617.382899] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.383027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.383072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.383279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.383381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.383546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.383644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.383701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.383862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.383943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.384742] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.384840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.384933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.385271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.385329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.385408] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 168708e9-eb81-41d2-980f-38b87d38f3bf is going to be updated. [ 617.411088] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.411303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.411344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.411577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.411723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.411885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-168708e9-eb81-41d2-980f-38b87d38f3bf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.464593] env[65660]: INFO networking_nsxv3.common.synchronization [req-a185213f-63c0-48b9-bd9a-592def900f82 req-eb1ce362-5cbc-4b99-8944-d0580acad2cf tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 617.464942] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 617.465319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.465437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.466127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.466127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.466127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.466127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.466436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.466436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.466436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.466638] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.660653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.660827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.660948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.661208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.661317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.661529] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.661634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.661693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.661853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.661972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.662036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 is going to be updated. [ 617.700732] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.700732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.700732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.700732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.700732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.707459] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 in Status: IN_PROGRESS for 2s [ 617.880985] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 in Status: SUCCESS [ 617.881314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.881366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.881999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.881999] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.881999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.882208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.882349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.883048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.883048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.883048] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.887858] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.896456] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.896456] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.896456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.896456] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.896456] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.896456] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.896456] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.896942] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.896942] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.896942] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.919661] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.919810] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.919944] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.920122] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.920413] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-2798456e-663b-4b1b-b37f-4c3b174e79d8 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.920574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.920681] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.921039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.921177] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2798456e-663b-4b1b-b37f-4c3b174e79d8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.969367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.969633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.969746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.970018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.970169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.970400] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.970494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.970557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.970738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.970818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.970961] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 already deleted. [ 617.971064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.387351] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.387572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.387646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.387882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.388073] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.388172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.388233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.388385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.388467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.388550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.388692] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.388782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.388903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.389017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.389145] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.389241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.389300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.389440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.389513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.389591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.389677] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.393104] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.393625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.393801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.394042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.394250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.394504] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 is going to be created. [ 618.418838] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.419113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.419443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.419596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.419713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.423998] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.424246] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.424325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.424573] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.424720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.424874] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 2798456e-663b-4b1b-b37f-4c3b174e79d8 not found, creating... [ 618.425126] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.425274] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.425381] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.425585] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.425708] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.426024] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.426184] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.426293] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.426488] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.426618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.426742] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 2798456e-663b-4b1b-b37f-4c3b174e79d8 is going to be created. [ 618.430822] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2dca75-cd86-462e-b41c-7286490b3384 in Status: UNINITIALIZED for 2s [ 618.448600] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.448883] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.448955] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.449301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.449552] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.449766] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.457237] env[65660]: INFO networking_nsxv3.common.synchronization [None req-deaea00a-827a-4c8b-8141-68c79389210d None None] Enqueued Resource ID: 852acd77-00d8-4f79-98de-7e6b6cabcb24 with Priority: HIGHEST for action port [ 618.457237] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 852acd77-00d8-4f79-98de-7e6b6cabcb24 with Priority: HIGHEST for action port [ 618.457715] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-852acd77-00d8-4f79-98de-7e6b6cabcb24 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.457839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-852acd77-00d8-4f79-98de-7e6b6cabcb24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.457905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-852acd77-00d8-4f79-98de-7e6b6cabcb24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.458247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-852acd77-00d8-4f79-98de-7e6b6cabcb24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.458328] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('852acd77-00d8-4f79-98de-7e6b6cabcb24',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.896909] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5546cce7-b8e5-406f-8abd-1541b01097c9: rpc.has_security_group_logging(os_id): False [ 618.916157] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.916371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.916412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.916603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.916693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.917331] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.917331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.917331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.917331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.917331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.917591] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.917591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.917660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.917787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.917859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.918178] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.918313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.918418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.918574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.918677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.918867] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 is going to be created. [ 618.962863] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 852acd77-00d8-4f79-98de-7e6b6cabcb24 [ 618.962863] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.962863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.962863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.962863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.963270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.963270] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:852acd77-00d8-4f79-98de-7e6b6cabcb24 already deleted. [ 618.963270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-852acd77-00d8-4f79-98de-7e6b6cabcb24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.988462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.988625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.988729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.989471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.989749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.008206] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 in Status: IN_PROGRESS for 2s [ 619.095695] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b in Status: SUCCESS [ 619.095850] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b deletion is rescheduled due to dependency. [ 619.096172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.253226] env[65660]: INFO networking_nsxv3.common.synchronization [req-a185213f-63c0-48b9-bd9a-592def900f82 req-320562f0-4f04-47e8-98d7-6500bb37a521 service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 619.253514] env[65660]: INFO networking_nsxv3.common.synchronization [req-a185213f-63c0-48b9-bd9a-592def900f82 req-320562f0-4f04-47e8-98d7-6500bb37a521 service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 619.253919] env[65660]: INFO networking_nsxv3.common.synchronization [req-a185213f-63c0-48b9-bd9a-592def900f82 req-320562f0-4f04-47e8-98d7-6500bb37a521 service nova] Enqueued Resource ID: 2798456e-663b-4b1b-b37f-4c3b174e79d8 with Priority: HIGHEST for action port [ 619.254310] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 619.254635] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 619.254880] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2798456e-663b-4b1b-b37f-4c3b174e79d8 with Priority: HIGHEST for action port [ 619.255652] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.255877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.255877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.256233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.256316] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.257175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.257386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.257386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.257559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.258409] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.258409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.258409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.258409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.260367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.260811] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.262644] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2798456e-663b-4b1b-b37f-4c3b174e79d8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.262744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.262787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.264134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.265034] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2798456e-663b-4b1b-b37f-4c3b174e79d8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.688325] env[65660]: INFO networking_nsxv3.common.synchronization [req-dc6e585e-6531-488c-a3a7-45fe404d3fa9 req-98ef9a16-1a23-480c-8606-ff0d59a0df51 tempest-InstanceActionsNegativeTestJSON-583814203 tempest-InstanceActionsNegativeTestJSON-583814203-project-member] Enqueued Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_members [ 619.688876] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_members [ 619.689229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.689358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.689424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.689689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.689844] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.689938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.689996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.690641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.690735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.690823] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.719146] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 in Status: SUCCESS [ 619.719146] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 deletion is rescheduled due to dependency. [ 619.719146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.766568] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.766746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.766913] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.767935] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2798456e-663b-4b1b-b37f-4c3b174e79d8 with status ACTIVE [ 619.768142] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.768256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.768321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.768531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.768612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.768792] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.768911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.769807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.769807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.769807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.769807] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.771652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.771721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.771946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.772335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.772463] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2798456e-663b-4b1b-b37f-4c3b174e79d8 is going to be updated. [ 619.809994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.810207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.810253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.810456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.810622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.810795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2798456e-663b-4b1b-b37f-4c3b174e79d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.060164] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.060819] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.060819] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.060819] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.061242] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.061471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.061750] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.062126] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.062368] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.062708] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.062919] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.063124] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.063378] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.063492] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.063695] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.063923] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.083030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.083233] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.083339] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.083506] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.083789] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-110e816f-315a-46ef-b41c-ec2940656b74 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.083956] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.084076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.084395] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.084515] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('110e816f-315a-46ef-b41c-ec2940656b74',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.193236] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.193469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.193505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.193805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.193922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.194145] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.194279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.194376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.194608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.194716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.194809] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769f17ed-cec0-4733-bb67-f90cba106a02 already deleted. [ 620.194898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.238887] env[65660]: INFO networking_nsxv3.common.synchronization [req-64c9ad67-a1f2-469d-ae2c-e716ed56c475 req-71cc4299-1ef6-4335-8b39-b85e002aa90f tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: 8bfcdba3-b6df-4239-b840-ab5408805a7f with Priority: HIGHEST for action security_group_rules [ 620.238887] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bfcdba3-b6df-4239-b840-ab5408805a7f with Priority: HIGHEST for action security_group_rules [ 620.238887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bfcdba3-b6df-4239-b840-ab5408805a7f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.238887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bfcdba3-b6df-4239-b840-ab5408805a7f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.239241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bfcdba3-b6df-4239-b840-ab5408805a7f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.239634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bfcdba3-b6df-4239-b840-ab5408805a7f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.239872] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bfcdba3-b6df-4239-b840-ab5408805a7f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.274771] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.441101] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2dca75-cd86-462e-b41c-7286490b3384 in Status: SUCCESS [ 620.441331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.441503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.441713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.442275] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.442275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.442275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.442428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.442493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.442637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.442759] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.590584] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.590584] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 110e816f-315a-46ef-b41c-ec2940656b74 not found, creating... [ 620.590584] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.590584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.591025] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.591025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.591025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.592617] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.592617] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.592617] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 110e816f-315a-46ef-b41c-ec2940656b74 is going to be created. [ 620.618339] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.618339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.618339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.618339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.618339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.618339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.765386] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.765632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.765739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.766071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.766332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.766518] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bfcdba3-b6df-4239-b840-ab5408805a7f already deleted. [ 620.766683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bfcdba3-b6df-4239-b840-ab5408805a7f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.778835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.778835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.778835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.778835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.778835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.778835] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be created. [ 620.812126] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.812126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.812126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.812305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.813086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.826503] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: UNINITIALIZED for 2s [ 620.945880] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.020026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 in Status: SUCCESS [ 621.020389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.210845] env[65660]: INFO networking_nsxv3.common.synchronization [None req-57db9a5e-2856-4d16-9d28-58d318892354 None None] Enqueued Resource ID: a538ffbc-9692-4ea0-9c21-80bd1e76f90b with Priority: HIGHEST for action port [ 621.210845] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a538ffbc-9692-4ea0-9c21-80bd1e76f90b with Priority: HIGHEST for action port [ 621.210845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a538ffbc-9692-4ea0-9c21-80bd1e76f90b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.210845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a538ffbc-9692-4ea0-9c21-80bd1e76f90b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.210845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a538ffbc-9692-4ea0-9c21-80bd1e76f90b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.210845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a538ffbc-9692-4ea0-9c21-80bd1e76f90b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.210845] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a538ffbc-9692-4ea0-9c21-80bd1e76f90b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.351874] env[65660]: INFO networking_nsxv3.common.synchronization [req-dc6e585e-6531-488c-a3a7-45fe404d3fa9 req-69592b43-5c8e-4bb5-be5a-f35f83e58ad7 service nova] Enqueued Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_rules [ 621.352186] env[65660]: INFO networking_nsxv3.common.synchronization [req-dc6e585e-6531-488c-a3a7-45fe404d3fa9 req-69592b43-5c8e-4bb5-be5a-f35f83e58ad7 service nova] Enqueued Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_members [ 621.352735] env[65660]: INFO networking_nsxv3.common.synchronization [req-dc6e585e-6531-488c-a3a7-45fe404d3fa9 req-69592b43-5c8e-4bb5-be5a-f35f83e58ad7 service nova] Enqueued Resource ID: 110e816f-315a-46ef-b41c-ec2940656b74 with Priority: HIGHEST for action port [ 621.353417] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_rules [ 621.353552] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_members [ 621.353715] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110e816f-315a-46ef-b41c-ec2940656b74 with Priority: HIGHEST for action port [ 621.353988] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.354154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.354258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.354521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.354618] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.355933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.356104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.356203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.356397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.356557] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.356657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.356732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.356875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.356972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.357411] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.358219] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-110e816f-315a-46ef-b41c-ec2940656b74 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.358330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.358396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.358548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.358625] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('110e816f-315a-46ef-b41c-ec2940656b74',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.451218] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b2dca75-cd86-462e-b41c-7286490b3384: rpc.has_security_group_logging(os_id): False [ 621.470626] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.470626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.470799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.471313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.471422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.471663] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.471791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.471852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.473544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.473544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.473544] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 is going to be created. [ 621.608875] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.609041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.609134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.609362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.609537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.620516] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b2dca75-cd86-462e-b41c-7286490b3384 in Status: IN_PROGRESS for 2s [ 621.715971] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a538ffbc-9692-4ea0-9c21-80bd1e76f90b [ 621.716580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.716580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.716580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.716764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.716857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.716979] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a538ffbc-9692-4ea0-9c21-80bd1e76f90b already deleted. [ 621.717099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a538ffbc-9692-4ea0-9c21-80bd1e76f90b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.861312] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.862538] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.862723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.863397] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 110e816f-315a-46ef-b41c-ec2940656b74 with status ACTIVE [ 621.863488] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.863686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.863686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.864048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.864183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.864445] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.864612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.865336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.865336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.865336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.865336] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.865925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.865925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.865925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.866034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.866079] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 110e816f-315a-46ef-b41c-ec2940656b74 is going to be updated. [ 621.892853] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.892853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.892853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.892853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.892853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.892853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-110e816f-315a-46ef-b41c-ec2940656b74" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.363775] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.837863] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 622.838152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.838341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.838599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.838796] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.838918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.839015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.839242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.839335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.839442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.839536] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.867841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.867841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.867841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.868095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.868095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.868163] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769f17ed-cec0-4733-bb67-f90cba106a02 is going to be created. [ 622.892051] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.892248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.893196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.893196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.893196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.904346] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769f17ed-cec0-4733-bb67-f90cba106a02 in Status: UNINITIALIZED for 2s [ 623.342473] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.342779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.342871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.343135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.343346] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.343492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.343569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.344113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.344113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.344113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.344481] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.344481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.344481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.344644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.344677] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.344794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.344857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.345055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.345134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.345222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.345357] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.634512] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b2dca75-cd86-462e-b41c-7286490b3384 in Status: SUCCESS [ 623.634887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.848792] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 335a6866-6ca7-4c63-a411-59c67e151de0: rpc.has_security_group_logging(os_id): False [ 623.873190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.873190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.873190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.874345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.874885] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.875278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.877358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.877358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.877358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.877358] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be created. [ 623.939507] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.939667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.939739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.939965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.940226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.955838] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 624.916976] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769f17ed-cec0-4733-bb67-f90cba106a02 in Status: SUCCESS [ 624.917747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.918992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.919251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.920993] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.920993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.920993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.920993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.920993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.920993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.920993] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.424290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.424290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.424290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.424685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.424685] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.424685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.424685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.424826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.424935] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.424996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.425076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.425217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.425310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.425393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.425482] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.927215] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 769f17ed-cec0-4733-bb67-f90cba106a02: rpc.has_security_group_logging(os_id): False [ 625.948356] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.948736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.948814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.949143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.949243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.949498] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.949714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.949714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.949944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.949944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.950094] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.950188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.950247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.950386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.950458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.950633] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.950738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.950813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.951124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.951124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.951221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 769f17ed-cec0-4733-bb67-f90cba106a02 is going to be created. [ 625.966662] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 625.966778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.026187] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.026318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.026656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.026656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.026918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.038784] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 769f17ed-cec0-4733-bb67-f90cba106a02 in Status: IN_PROGRESS for 2s [ 626.354269] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 626.354510] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 627.432710] env[65660]: INFO networking_nsxv3.common.synchronization [req-6327865b-b9ec-458f-bc7d-68911fd14366 req-c199de33-19ee-44ab-8f69-fcaf9dc83dec tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: 71f81eb1-e692-4b90-b3ae-fd52f95b203d with Priority: HIGHEST for action security_group_rules [ 627.434893] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f81eb1-e692-4b90-b3ae-fd52f95b203d with Priority: HIGHEST for action security_group_rules [ 627.435337] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71f81eb1-e692-4b90-b3ae-fd52f95b203d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.435584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71f81eb1-e692-4b90-b3ae-fd52f95b203d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.435700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71f81eb1-e692-4b90-b3ae-fd52f95b203d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.436109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71f81eb1-e692-4b90-b3ae-fd52f95b203d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.436332] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71f81eb1-e692-4b90-b3ae-fd52f95b203d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.731149] env[65660]: INFO networking_nsxv3.common.synchronization [req-0c71393e-d463-4149-b843-d0b15195fc80 req-5d163c31-bc78-4cb3-974a-8cb69fc78d8b tempest-TenantUsagesTestJSON-27473038 tempest-TenantUsagesTestJSON-27473038-project-member] Enqueued Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_members [ 627.731822] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_members [ 627.732223] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.732480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.732639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.732941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.733164] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.733381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.733486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.733692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.733886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.734158] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.966585] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.966781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.966892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.967261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.967422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.967572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71f81eb1-e692-4b90-b3ae-fd52f95b203d already deleted. [ 627.967701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71f81eb1-e692-4b90-b3ae-fd52f95b203d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.055449] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 769f17ed-cec0-4733-bb67-f90cba106a02 in Status: SUCCESS [ 628.055879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236475] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.236706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236825] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.237175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.237256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.237335] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4952419-31e9-43c3-93de-73b6983584c2 already deleted. [ 628.237410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.363193] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.363542] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.363672] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.363937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.364226] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.364565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.364702] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.364920] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.365078] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.365287] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.365398] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.365503] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.365607] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.365711] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.365813] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.365940] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.390949] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.391190] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.391326] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.391494] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.391798] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-88c0ec2d-5e56-449c-a8b0-35caa2050a24 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.392042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.392172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.392443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.392921] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c0ec2d-5e56-449c-a8b0-35caa2050a24',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.895722] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.896129] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.896129] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.896405] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.896499] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.896616] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 88c0ec2d-5e56-449c-a8b0-35caa2050a24 not found, creating... [ 628.896882] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.897100] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.897152] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.897424] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.897519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.897747] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.897896] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.898015] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.898746] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.898886] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.899050] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 88c0ec2d-5e56-449c-a8b0-35caa2050a24 is going to be created. [ 628.921621] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.921621] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.921832] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.921957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.922196] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.922422] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.655835] env[65660]: INFO networking_nsxv3.common.synchronization [req-0c71393e-d463-4149-b843-d0b15195fc80 req-d6e79de8-4672-474d-bb64-372193d4e217 service nova] Enqueued Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_rules [ 629.655835] env[65660]: INFO networking_nsxv3.common.synchronization [req-0c71393e-d463-4149-b843-d0b15195fc80 req-d6e79de8-4672-474d-bb64-372193d4e217 service nova] Enqueued Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_members [ 629.655835] env[65660]: INFO networking_nsxv3.common.synchronization [req-0c71393e-d463-4149-b843-d0b15195fc80 req-d6e79de8-4672-474d-bb64-372193d4e217 service nova] Enqueued Resource ID: 88c0ec2d-5e56-449c-a8b0-35caa2050a24 with Priority: HIGHEST for action port [ 629.655835] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_rules [ 629.655835] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_members [ 629.655835] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c0ec2d-5e56-449c-a8b0-35caa2050a24 with Priority: HIGHEST for action port [ 629.655835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.655835] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.655835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.655835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.655835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.656989] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.657501] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-88c0ec2d-5e56-449c-a8b0-35caa2050a24 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.657640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.657709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.662019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.662019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c0ec2d-5e56-449c-a8b0-35caa2050a24',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.045982] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2e1a401d-31fc-4871-af54-831363d2b4d3 None None] Enqueued Resource ID: 74b24f29-6382-47f6-a29c-2b799239a074 with Priority: HIGHEST for action port [ 630.046630] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b24f29-6382-47f6-a29c-2b799239a074 with Priority: HIGHEST for action port [ 630.046955] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b24f29-6382-47f6-a29c-2b799239a074 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.047099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b24f29-6382-47f6-a29c-2b799239a074" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.047171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b24f29-6382-47f6-a29c-2b799239a074" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.047608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b24f29-6382-47f6-a29c-2b799239a074" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.047654] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b24f29-6382-47f6-a29c-2b799239a074',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.161480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.161480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.161480] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.164036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88c0ec2d-5e56-449c-a8b0-35caa2050a24 with status ACTIVE [ 630.164036] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.164036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.164036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.168213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.168213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.168213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.168213] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88c0ec2d-5e56-449c-a8b0-35caa2050a24 is going to be updated. [ 630.191654] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.191654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.191654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.191654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.191654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.191654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88c0ec2d-5e56-449c-a8b0-35caa2050a24" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.549522] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74b24f29-6382-47f6-a29c-2b799239a074 [ 630.549744] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.549876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.549943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.550200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.550295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.550388] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74b24f29-6382-47f6-a29c-2b799239a074 already deleted. [ 630.550473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b24f29-6382-47f6-a29c-2b799239a074" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.662910] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.166325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.166887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.166887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.166887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.166887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.167218] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4952419-31e9-43c3-93de-73b6983584c2 is going to be created. [ 631.194994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.195156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.195226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.195427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.195582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.206423] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4952419-31e9-43c3-93de-73b6983584c2 in Status: UNINITIALIZED for 2s [ 632.348391] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f12109a5-a9c2-4ad5-837d-77c9f7abfe92 None None] Enqueued Resource ID: e8af1e9e-3fb1-4abb-a5c3-8882f0904029 with Priority: HIGHEST for action port [ 632.350618] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8af1e9e-3fb1-4abb-a5c3-8882f0904029 with Priority: HIGHEST for action port [ 632.351586] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8af1e9e-3fb1-4abb-a5c3-8882f0904029 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.351586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8af1e9e-3fb1-4abb-a5c3-8882f0904029" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.351586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8af1e9e-3fb1-4abb-a5c3-8882f0904029" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.351586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8af1e9e-3fb1-4abb-a5c3-8882f0904029" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.351586] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8af1e9e-3fb1-4abb-a5c3-8882f0904029',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.855890] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8af1e9e-3fb1-4abb-a5c3-8882f0904029 [ 632.855890] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.855890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.855890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.855890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.855890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.855890] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8af1e9e-3fb1-4abb-a5c3-8882f0904029 already deleted. [ 632.855890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8af1e9e-3fb1-4abb-a5c3-8882f0904029" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.221098] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4952419-31e9-43c3-93de-73b6983584c2 in Status: SUCCESS [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.221098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.221098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.221098] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.723569] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.724059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.724059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.724059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.724308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.724308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.724458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.724511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.724569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.724636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.724777] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.724856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.724912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.725057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.725626] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.725626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.725626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.725831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.725831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.725831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.725934] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.770268] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5b9d29fc-f9b4-4ede-b99b-dce83fe53b36 tempest-ServersTestJSON-1232390414 tempest-ServersTestJSON-1232390414-project-member] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_rules [ 633.770268] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_rules [ 633.770834] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.770834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.770834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.770962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.771013] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.197640] env[65660]: INFO networking_nsxv3.common.synchronization [None req-8b753516-2f63-4553-b7b3-28f3889073af tempest-ServersTestJSON-1232390414 tempest-ServersTestJSON-1232390414-project-member] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_rules [ 634.198222] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_rules [ 634.198581] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.198714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.229858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4952419-31e9-43c3-93de-73b6983584c2: rpc.has_security_group_logging(os_id): False [ 634.250972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.250972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.250972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.250972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.250972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.250972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.250972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.250972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.251464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.251464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.251538] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.251613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.251670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.251779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.251890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.252132] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.252267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.252267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.252553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.252553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.252659] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4952419-31e9-43c3-93de-73b6983584c2 is going to be created. [ 634.296897] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.297047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.298016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.298016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.298016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.298016] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e already deleted. [ 634.298016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.298016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.298016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.298016] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.327084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.327256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.327305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.327506] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.327678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.342550] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4952419-31e9-43c3-93de-73b6983584c2 in Status: IN_PROGRESS for 2s [ 634.445577] env[65660]: INFO networking_nsxv3.common.synchronization [None req-895032fa-4827-45fd-bd3e-f46a9949862f None None] Enqueued Resource ID: 4037203c-380f-4b75-b89e-f21d00d509f8 with Priority: HIGHEST for action port [ 634.447919] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4037203c-380f-4b75-b89e-f21d00d509f8 with Priority: HIGHEST for action port [ 634.448367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4037203c-380f-4b75-b89e-f21d00d509f8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.448532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4037203c-380f-4b75-b89e-f21d00d509f8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.449144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4037203c-380f-4b75-b89e-f21d00d509f8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.449513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4037203c-380f-4b75-b89e-f21d00d509f8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.449610] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4037203c-380f-4b75-b89e-f21d00d509f8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.697170] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f1a78608-71a0-4d9b-a550-1a78f7094824 None None] Enqueued Resource ID: 16cadd92-c2dc-4ef3-9010-3e89afc6d529 with Priority: HIGHEST for action port [ 634.697170] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16cadd92-c2dc-4ef3-9010-3e89afc6d529 with Priority: HIGHEST for action port [ 634.697170] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-16cadd92-c2dc-4ef3-9010-3e89afc6d529 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.697170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16cadd92-c2dc-4ef3-9010-3e89afc6d529" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.697170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16cadd92-c2dc-4ef3-9010-3e89afc6d529" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.697170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16cadd92-c2dc-4ef3-9010-3e89afc6d529" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.697170] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cadd92-c2dc-4ef3-9010-3e89afc6d529',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.827516] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.827516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.827516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.827516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.828024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.828024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e already deleted. [ 634.828024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.953680] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4037203c-380f-4b75-b89e-f21d00d509f8 [ 634.954128] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.954712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.954816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.955073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.955175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.955603] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4037203c-380f-4b75-b89e-f21d00d509f8 already deleted. [ 634.955603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4037203c-380f-4b75-b89e-f21d00d509f8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.202262] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16cadd92-c2dc-4ef3-9010-3e89afc6d529 [ 635.202262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.202262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.202262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.202822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.203113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.203314] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16cadd92-c2dc-4ef3-9010-3e89afc6d529 already deleted. [ 635.204157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16cadd92-c2dc-4ef3-9010-3e89afc6d529" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.655672] env[65660]: INFO networking_nsxv3.common.synchronization [req-b881be87-e2f9-4d47-b1f5-ceee320b7d0e req-432a710c-8a73-4a28-8f4c-1dbf1afaeba6 tempest-ServersWithSpecificFlavorTestJSON-1002304921 tempest-ServersWithSpecificFlavorTestJSON-1002304921-project-member] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 635.658317] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 635.658697] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.658866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.658952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.659326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.659519] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.659651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.659771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.659930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.660050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.660300] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.961845] env[65660]: INFO networking_nsxv3.common.synchronization [req-dfd76b35-0524-4c17-b63a-4304144ec176 req-8356140b-9172-4181-82e8-85eba979c0b5 tempest-VolumesAdminNegativeTest-1465503759 tempest-VolumesAdminNegativeTest-1465503759-project-member] Enqueued Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_members [ 635.961845] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGHEST for action security_group_members [ 635.961845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.963667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.964734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.964734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.964734] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.964734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.965414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.965491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.965567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.965735] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.166790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.166956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.167025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.168074] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.168074] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 already deleted. [ 636.168074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.261451] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.261645] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.261759] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.262194] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.263040] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.263040] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.263040] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.263403] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.263508] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.263716] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.263826] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.263925] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.264037] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.264171] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.264317] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.264458] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.292397] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.293654] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.293654] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.293654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.293654] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-ed30a3d3-c0f6-43e8-b026-0eb69269726f taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.293654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.293654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.294818] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.295302] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed30a3d3-c0f6-43e8-b026-0eb69269726f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.357610] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4952419-31e9-43c3-93de-73b6983584c2 in Status: SUCCESS [ 636.357610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.471861] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.471861] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.471861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.471861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 is going to be updated. [ 636.504345] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec75eb14-7d39-45bb-968f-ad26dd04d29e req-21ad7172-ac9a-4f3a-859e-d46ef75265c6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 636.504936] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.505338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.505528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.505804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.506041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.507383] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 636.507790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.508307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.508572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.508886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.509158] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.509365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.509508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.509735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.510013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.510197] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.520156] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 in Status: IN_PROGRESS for 2s [ 636.762488] env[65660]: INFO networking_nsxv3.common.synchronization [None req-746cfc28-d099-4d19-9b00-2cd31e781f08 None None] Enqueued Resource ID: 09e9f37e-e080-425a-a614-f4fd7a5f270a with Priority: HIGHEST for action port [ 636.763063] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09e9f37e-e080-425a-a614-f4fd7a5f270a with Priority: HIGHEST for action port [ 636.763417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-09e9f37e-e080-425a-a614-f4fd7a5f270a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.763519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09e9f37e-e080-425a-a614-f4fd7a5f270a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.763588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09e9f37e-e080-425a-a614-f4fd7a5f270a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.763838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09e9f37e-e080-425a-a614-f4fd7a5f270a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.763922] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09e9f37e-e080-425a-a614-f4fd7a5f270a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.798307] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.798981] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.798981] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.799111] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.799220] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.799460] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port ed30a3d3-c0f6-43e8-b026-0eb69269726f not found, creating... [ 636.799779] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.801302] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.801302] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.801302] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.801302] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.801302] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.801619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.801619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.801847] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.802113] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.802113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: ed30a3d3-c0f6-43e8-b026-0eb69269726f is going to be created. [ 636.822459] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.822742] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.822808] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.823098] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.823342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.823593] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.012546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.012878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.012878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.013124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.013214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.015105] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.015105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.015105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.015105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.015105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.015105] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 already deleted. [ 637.015105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.268512] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09e9f37e-e080-425a-a614-f4fd7a5f270a [ 637.268512] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.268512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.268512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.268512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.268512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.268512] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09e9f37e-e080-425a-a614-f4fd7a5f270a already deleted. [ 637.268512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09e9f37e-e080-425a-a614-f4fd7a5f270a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.282941] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c44e03aa-c249-4c07-9999-ad70632a0860 None None] Enqueued Resource ID: c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d with Priority: HIGHEST for action port [ 637.283682] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d with Priority: HIGHEST for action port [ 637.283957] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.284132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.284219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.284422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.284516] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.434320] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-275 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.434544] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.434659] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.434982] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.435326] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.435489] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.435789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.435789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.436028] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.436148] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.436250] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.436355] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.436459] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.436563] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.436792] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.437164] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.467094] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.467338] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.467528] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.468821] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.468821] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-73db27ba-2f7b-4f0d-b9df-1221ea19d193 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.468821] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.468821] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.469557] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.469557] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73db27ba-2f7b-4f0d-b9df-1221ea19d193',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.546373] env[65660]: INFO networking_nsxv3.common.synchronization [req-b881be87-e2f9-4d47-b1f5-ceee320b7d0e req-bd23c65d-b936-4a68-8a9b-af62810854aa service nova] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 637.546559] env[65660]: INFO networking_nsxv3.common.synchronization [req-b881be87-e2f9-4d47-b1f5-ceee320b7d0e req-bd23c65d-b936-4a68-8a9b-af62810854aa service nova] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 637.546717] env[65660]: INFO networking_nsxv3.common.synchronization [req-b881be87-e2f9-4d47-b1f5-ceee320b7d0e req-bd23c65d-b936-4a68-8a9b-af62810854aa service nova] Enqueued Resource ID: ed30a3d3-c0f6-43e8-b026-0eb69269726f with Priority: HIGHEST for action port [ 637.547491] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 637.547715] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 637.547796] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed30a3d3-c0f6-43e8-b026-0eb69269726f with Priority: HIGHEST for action port [ 637.548592] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.548734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.548809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.549145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.549265] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.550390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.550865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.551029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.551236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.551342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.551445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.551502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.551647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.551731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.551856] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.552624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed30a3d3-c0f6-43e8-b026-0eb69269726f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.552739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.552780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.552924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.552992] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed30a3d3-c0f6-43e8-b026-0eb69269726f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.786817] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d [ 637.787090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.787226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.787290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.787510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.788661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.788661] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d already deleted. [ 637.788661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4fa1e18-8306-4f6f-9ac4-4d7377b2f44d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.972729] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.973192] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.973351] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.973647] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.973784] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.973934] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 73db27ba-2f7b-4f0d-b9df-1221ea19d193 not found, creating... [ 637.974223] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.974391] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.974507] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.974753] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.974906] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.975219] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.975407] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.975543] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.975793] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.975964] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.976165] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 is going to be created. [ 637.998192] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.998420] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.999039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.999039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.999039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.999303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.054605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.054948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.054948] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.057680] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed30a3d3-c0f6-43e8-b026-0eb69269726f with status ACTIVE [ 638.057867] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.058015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.058073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.058254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.058338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.058694] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.058694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.058694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.058877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.058877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.059092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.059176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.059230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.061940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.061940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.061940] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed30a3d3-c0f6-43e8-b026-0eb69269726f is going to be updated. [ 638.091445] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.091691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.092020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.092172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.092404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.092667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed30a3d3-c0f6-43e8-b026-0eb69269726f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.530947] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 in Status: SUCCESS [ 638.530947] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 deletion is rescheduled due to dependency. [ 638.530947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.557423] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.715964] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec75eb14-7d39-45bb-968f-ad26dd04d29e req-ea371bfc-2cbb-4266-af8b-f526da3a77d9 service nova] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 638.715964] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec75eb14-7d39-45bb-968f-ad26dd04d29e req-ea371bfc-2cbb-4266-af8b-f526da3a77d9 service nova] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 638.715964] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec75eb14-7d39-45bb-968f-ad26dd04d29e req-ea371bfc-2cbb-4266-af8b-f526da3a77d9 service nova] Enqueued Resource ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with Priority: HIGHEST for action port [ 638.715964] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 638.715964] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 638.715964] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with Priority: HIGHEST for action port [ 638.715964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.715964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.715964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.715964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.715964] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.716770] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.717349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.717349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.717349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.717349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.718096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.718096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.718096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.718096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.718096] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.718698] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-73db27ba-2f7b-4f0d-b9df-1221ea19d193 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.718818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.719264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.719264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.719264] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73db27ba-2f7b-4f0d-b9df-1221ea19d193',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.060912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.061334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.061334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.061459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.061459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.061564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be created. [ 639.087079] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.087079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.087342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.087381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.087547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.098846] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: UNINITIALIZED for 2s [ 639.212493] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b507306c-df56-47fc-ac51-be7117f03161 None None] Enqueued Resource ID: fc8fce30-d432-4f8b-8988-7f48ca64a049 with Priority: HIGHEST for action port [ 639.213253] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8fce30-d432-4f8b-8988-7f48ca64a049 with Priority: HIGHEST for action port [ 639.214201] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc8fce30-d432-4f8b-8988-7f48ca64a049 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.215787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc8fce30-d432-4f8b-8988-7f48ca64a049" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.215787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc8fce30-d432-4f8b-8988-7f48ca64a049" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.215787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc8fce30-d432-4f8b-8988-7f48ca64a049" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.215787] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc8fce30-d432-4f8b-8988-7f48ca64a049',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.221788] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.223801] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.223801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.225284] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with status ACTIVE [ 639.225284] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.225431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.225431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.226035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.226035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.226035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.226272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.226272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.226693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.226823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.227108] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.227713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.227847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.228135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.228266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.228689] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 is going to be updated. [ 639.271136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.271136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.271136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.271136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.271136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.271136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.515819] env[65660]: INFO networking_nsxv3.common.synchronization [req-3609c815-408c-4de1-a87e-02298824f7d6 req-ec25fd19-3596-4b35-97da-032ad48c2730 tempest-DeleteServersAdminTestJSON-1249113108 tempest-DeleteServersAdminTestJSON-1249113108-project-member] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 639.516732] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 639.516732] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.516732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.516732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.516995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.519030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.519235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.519235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.519397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.521397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.521397] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.718153] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc8fce30-d432-4f8b-8988-7f48ca64a049 [ 639.718475] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.718938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.719089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.719346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.719437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.719537] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc8fce30-d432-4f8b-8988-7f48ca64a049 already deleted. [ 639.719613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc8fce30-d432-4f8b-8988-7f48ca64a049" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.731551] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.025508] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.025668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.025728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.025941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.026044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.026230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.026324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.026387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.026544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.026632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.026717] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be updated. [ 640.054629] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.055094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.055189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.055416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.056447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.066804] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: IN_PROGRESS for 2s [ 640.070593] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.070593] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.070593] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.070593] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.071115] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.071115] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.073352] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.073352] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.073352] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.073352] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.073631] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.073631] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.073724] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.073785] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.073895] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.075026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.098174] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.098506] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.098506] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.098727] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.098911] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-64267d51-d65c-4737-98f2-706e69b5e1b5 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.099171] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.099251] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.099551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.099718] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64267d51-d65c-4737-98f2-706e69b5e1b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.235115] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.235634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.235634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.235634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.235634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.235807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be created. [ 640.279908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.280118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.280204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.280418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.280628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.300709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: UNINITIALIZED for 2s [ 640.603039] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.603363] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.603529] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.603856] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.604033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.604234] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 64267d51-d65c-4737-98f2-706e69b5e1b5 not found, creating... [ 640.604651] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.604754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.604858] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.605193] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.605307] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.605660] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.605835] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.606018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.609271] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.609487] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.610631] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 64267d51-d65c-4737-98f2-706e69b5e1b5 is going to be created. [ 640.636854] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.640890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.640890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.640890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.640890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.640890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.001561] env[65660]: INFO networking_nsxv3.common.synchronization [None req-39b6f3c0-c16c-4908-b177-e84d7a998f50 None None] Enqueued Resource ID: 459d04fc-8ca6-4e92-8683-831be1ea6a22 with Priority: HIGHEST for action port [ 641.002054] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459d04fc-8ca6-4e92-8683-831be1ea6a22 with Priority: HIGHEST for action port [ 641.002381] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-459d04fc-8ca6-4e92-8683-831be1ea6a22 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.002508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-459d04fc-8ca6-4e92-8683-831be1ea6a22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.002573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-459d04fc-8ca6-4e92-8683-831be1ea6a22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.002831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-459d04fc-8ca6-4e92-8683-831be1ea6a22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.002913] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('459d04fc-8ca6-4e92-8683-831be1ea6a22',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.111326] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 641.111672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.111874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.113908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.113908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.113908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.113908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.113908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.113908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.113908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.113908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.317587] env[65660]: INFO networking_nsxv3.common.synchronization [req-3609c815-408c-4de1-a87e-02298824f7d6 req-b50289c3-7975-46ab-a53d-7e4a04a929f5 service nova] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_rules [ 641.317757] env[65660]: INFO networking_nsxv3.common.synchronization [req-3609c815-408c-4de1-a87e-02298824f7d6 req-b50289c3-7975-46ab-a53d-7e4a04a929f5 service nova] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 641.318200] env[65660]: INFO networking_nsxv3.common.synchronization [req-3609c815-408c-4de1-a87e-02298824f7d6 req-b50289c3-7975-46ab-a53d-7e4a04a929f5 service nova] Enqueued Resource ID: 64267d51-d65c-4737-98f2-706e69b5e1b5 with Priority: HIGHEST for action port [ 641.318200] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_rules [ 641.318397] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 641.318397] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64267d51-d65c-4737-98f2-706e69b5e1b5 with Priority: HIGHEST for action port [ 641.318885] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.319856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.320044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.320306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.320463] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.322040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.322207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.322540] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-64267d51-d65c-4737-98f2-706e69b5e1b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.322693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.322794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.323879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.324009] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64267d51-d65c-4737-98f2-706e69b5e1b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.506610] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 459d04fc-8ca6-4e92-8683-831be1ea6a22 [ 641.506610] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.506610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.506610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.506939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.508308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.508428] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:459d04fc-8ca6-4e92-8683-831be1ea6a22 already deleted. [ 641.508539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-459d04fc-8ca6-4e92-8683-831be1ea6a22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.620818] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.823360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.823551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.828278] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64267d51-d65c-4737-98f2-706e69b5e1b5 with status ACTIVE [ 641.828278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.829079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.829079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.829079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.829079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.829079] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.829322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.829322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.829383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.829428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.829818] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.829818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.829818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.829964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.830040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.830115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64267d51-d65c-4737-98f2-706e69b5e1b5 is going to be updated. [ 641.853122] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.853122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.853122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.853122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.853122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.853122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64267d51-d65c-4737-98f2-706e69b5e1b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.081420] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 642.081420] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 deletion is rescheduled due to dependency. [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.081420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.081420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.081420] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.123454] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db90b51b-f35c-42cc-8ed2-59a87f10bd43: rpc.has_security_group_logging(os_id): False [ 642.156278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.156278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.156278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.156278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.156278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.156278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.156278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.156584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.156584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.156584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.156680] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be created. [ 642.248090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.248090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.248090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.248090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.248090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.264270] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: IN_PROGRESS for 2s [ 642.312071] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 642.312366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.312546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.312800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.312993] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.313121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.313193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.313407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.313488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.313574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.313677] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.585522] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.768945] env[65660]: INFO networking_nsxv3.common.synchronization [req-e65c4358-311f-40af-ab07-6a7433fc28f4 req-471e2841-25d6-4b7e-8678-91b8a42487af tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 with Priority: HIGHEST for action security_group_rules [ 642.769673] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 with Priority: HIGHEST for action security_group_rules [ 642.770015] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.770150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.770218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.770490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.770574] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.818810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.820269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.820382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.820647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.821073] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.821073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.821073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.821412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.821517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.822435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.822435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.822435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.822435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.822435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.823870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.823870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.823870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.823870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.823870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.823870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.823870] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.089113] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.291503] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.291816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.291816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.291816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.291999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.291999] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 already deleted. [ 643.292129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.328961] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 643.347827] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.350416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.350464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.350674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.350772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.350984] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.351132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.351223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.351354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.351645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.351645] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.351805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.351805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.351936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.351990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.352200] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.352294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.352363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.352502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.352573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.352657] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be created. [ 643.443368] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.443823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.443823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.445601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.445601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.457912] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 643.593943] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.594245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.594337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.594571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.594728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.594850] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be updated. [ 643.633098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.633312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.633632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.633632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.633724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.647194] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: IN_PROGRESS for 2s [ 644.281654] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 644.281943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.473425] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 645.473674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.659926] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 645.659926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.660209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.660633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.660770] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.660839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.660923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.661664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.661856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.662177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.662177] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.916539] env[65660]: INFO networking_nsxv3.common.synchronization [req-f9a5e213-4a82-4030-a601-b8fb4d2d3d70 req-3b1ce035-1411-4224-8a9b-8714f57f5be4 tempest-InstanceActionsNegativeTestJSON-583814203 tempest-InstanceActionsNegativeTestJSON-583814203-project-member] Enqueued Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_members [ 645.917497] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGHEST for action security_group_members [ 645.917985] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.918198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.918272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.918581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.918865] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.919149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.919270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.919775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.919775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.919966] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.165589] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.165811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.165811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.165995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.166238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.166332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.166385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.166561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.166648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.166744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.168040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.168040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.168040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.168040] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.235381] env[65660]: INFO networking_nsxv3.common.synchronization [None req-4875c324-91ba-4ee0-829c-2333d282986f None None] Enqueued Resource ID: 83056c0a-c058-425e-966b-1383363fcd1c with Priority: HIGHEST for action port [ 646.236076] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83056c0a-c058-425e-966b-1383363fcd1c with Priority: HIGHEST for action port [ 646.236799] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-83056c0a-c058-425e-966b-1383363fcd1c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.237087] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83056c0a-c058-425e-966b-1383363fcd1c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.237165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83056c0a-c058-425e-966b-1383363fcd1c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.237719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83056c0a-c058-425e-966b-1383363fcd1c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.238016] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83056c0a-c058-425e-966b-1383363fcd1c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.426759] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.427101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.427196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.427522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.427686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.428024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.428199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.428579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.428579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.428746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.428789] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769f17ed-cec0-4733-bb67-f90cba106a02 is going to be updated. [ 646.469899] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.470201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.470201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.470309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.470446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.489119] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769f17ed-cec0-4733-bb67-f90cba106a02 in Status: IN_PROGRESS for 2s [ 646.671702] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c5cc4f2-b09e-4802-8402-1b312af39573: rpc.has_security_group_logging(os_id): False [ 646.693538] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.693693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.693763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.693993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.694110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.694325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.694423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.694485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.694632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.694706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.694876] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.694966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.695038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.695178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.695251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.695480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.695564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.695603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.695719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.695790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.695870] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be updated. [ 646.740887] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83056c0a-c058-425e-966b-1383363fcd1c [ 646.741267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.741458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.741546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.741797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.741893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.742012] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83056c0a-c058-425e-966b-1383363fcd1c already deleted. [ 646.742111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83056c0a-c058-425e-966b-1383363fcd1c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.774134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.774134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.774134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.774134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.774474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.796153] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: IN_PROGRESS for 2s [ 648.500164] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769f17ed-cec0-4733-bb67-f90cba106a02 in Status: SUCCESS [ 648.500471] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769f17ed-cec0-4733-bb67-f90cba106a02 deletion is rescheduled due to dependency. [ 648.500471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.642509] env[65660]: INFO networking_nsxv3.common.synchronization [None req-665f713e-8938-4042-ae22-d57cfd8f0b61 None None] Enqueued Resource ID: 06327b6b-8a9e-4887-b165-50df32229d85 with Priority: HIGHEST for action port [ 648.643177] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06327b6b-8a9e-4887-b165-50df32229d85 with Priority: HIGHEST for action port [ 648.643591] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-06327b6b-8a9e-4887-b165-50df32229d85 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.643763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06327b6b-8a9e-4887-b165-50df32229d85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.643826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06327b6b-8a9e-4887-b165-50df32229d85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.644139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06327b6b-8a9e-4887-b165-50df32229d85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.644223] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06327b6b-8a9e-4887-b165-50df32229d85',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.814829] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 648.815105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.148254] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06327b6b-8a9e-4887-b165-50df32229d85 [ 649.148254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.149415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.149415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.149415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.149415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.149415] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06327b6b-8a9e-4887-b165-50df32229d85 already deleted. [ 649.149415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06327b6b-8a9e-4887-b165-50df32229d85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.985894] env[65660]: INFO networking_nsxv3.common.synchronization [req-c13399e1-f2ca-4f01-939c-9328d351517e req-8d8c44a5-3985-4bfc-a3ae-3550e5fc5fa1 tempest-ServersTestJSON-1232390414 tempest-ServersTestJSON-1232390414-project-member] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_members [ 649.985894] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_members [ 649.985894] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.985894] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.985894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.986673] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.299239] env[65660]: INFO networking_nsxv3.common.synchronization [None req-9dbfb84c-41d9-491b-880c-3ff66cba247a None None] Enqueued Resource ID: 0e5a33a4-ab0f-454c-a316-9cab60c4ab64 with Priority: HIGHEST for action port [ 650.300291] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e5a33a4-ab0f-454c-a316-9cab60c4ab64 with Priority: HIGHEST for action port [ 650.301946] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e5a33a4-ab0f-454c-a316-9cab60c4ab64 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.301946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e5a33a4-ab0f-454c-a316-9cab60c4ab64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.301946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e5a33a4-ab0f-454c-a316-9cab60c4ab64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.301946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e5a33a4-ab0f-454c-a316-9cab60c4ab64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.302845] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e5a33a4-ab0f-454c-a316-9cab60c4ab64',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.492257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.492257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.492257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.492257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.492257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.492257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.492257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.492257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.492675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.492675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.492675] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e already deleted. [ 650.492675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.802416] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-359 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.802698] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-359" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.802744] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-359" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.803076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-359" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.803592] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.803592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.803592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.805012] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.805012] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.805012] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.805012] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.805012] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.805012] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.805012] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.805012] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.805012] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.808994] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e5a33a4-ab0f-454c-a316-9cab60c4ab64 [ 650.808994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.808994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.808994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.808994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.808994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.808994] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e5a33a4-ab0f-454c-a316-9cab60c4ab64 already deleted. [ 650.808994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e5a33a4-ab0f-454c-a316-9cab60c4ab64" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.832384] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.836218] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.836458] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.836822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-359" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.837147] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-d555107c-993e-49de-8643-5d1c667ec5de taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.839030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.839030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.839269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.839444] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d555107c-993e-49de-8643-5d1c667ec5de',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.890079] env[65660]: INFO networking_nsxv3.common.synchronization [None req-7fdd80c6-2462-4b2e-b295-42aefce0c066 None None] Enqueued Resource ID: 0df019d5-345c-4997-bb86-c25861fc4d3c with Priority: HIGHEST for action port [ 650.891020] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0df019d5-345c-4997-bb86-c25861fc4d3c with Priority: HIGHEST for action port [ 650.891516] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0df019d5-345c-4997-bb86-c25861fc4d3c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.891659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0df019d5-345c-4997-bb86-c25861fc4d3c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.891730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0df019d5-345c-4997-bb86-c25861fc4d3c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.891986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0df019d5-345c-4997-bb86-c25861fc4d3c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.892085] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0df019d5-345c-4997-bb86-c25861fc4d3c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.342116] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.342565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.342651] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.342974] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.343202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.343407] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port d555107c-993e-49de-8643-5d1c667ec5de not found, creating... [ 651.343741] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.343951] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.344127] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.344743] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.344743] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.344983] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.345221] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.345370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.345670] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.345844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.346035] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: d555107c-993e-49de-8643-5d1c667ec5de is going to be created. [ 651.370565] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.370834] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.370971] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.371376] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.371672] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.372058] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.394254] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0df019d5-345c-4997-bb86-c25861fc4d3c [ 651.394610] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.395133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.395133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.395318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.395318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.395400] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0df019d5-345c-4997-bb86-c25861fc4d3c already deleted. [ 651.395453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0df019d5-345c-4997-bb86-c25861fc4d3c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.152677] env[65660]: INFO networking_nsxv3.common.synchronization [req-c13399e1-f2ca-4f01-939c-9328d351517e req-f106d6f1-3a8d-4432-be31-bfd5c6516685 service nova] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_rules [ 652.152909] env[65660]: INFO networking_nsxv3.common.synchronization [req-c13399e1-f2ca-4f01-939c-9328d351517e req-f106d6f1-3a8d-4432-be31-bfd5c6516685 service nova] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_members [ 652.153559] env[65660]: INFO networking_nsxv3.common.synchronization [req-c13399e1-f2ca-4f01-939c-9328d351517e req-f106d6f1-3a8d-4432-be31-bfd5c6516685 service nova] Enqueued Resource ID: d555107c-993e-49de-8643-5d1c667ec5de with Priority: HIGHEST for action port [ 652.154074] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_rules [ 652.154311] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_members [ 652.154497] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d555107c-993e-49de-8643-5d1c667ec5de with Priority: HIGHEST for action port [ 652.154854] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.154956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.154956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.155205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.155288] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.156328] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.156420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.156522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.156831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.156831] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.157057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.157057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.157124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.157211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.157266] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.163105] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d555107c-993e-49de-8643-5d1c667ec5de taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.163105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.163105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.163105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.163105] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d555107c-993e-49de-8643-5d1c667ec5de',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.663406] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d555107c-993e-49de-8643-5d1c667ec5de with status ACTIVE [ 652.663704] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.664552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.664552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.664552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.664552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.664812] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.664812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.664903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.665196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.665291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.666043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.666043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.666043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.666043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.666288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.666288] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d555107c-993e-49de-8643-5d1c667ec5de is going to be updated. [ 652.668402] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.669747] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.669912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.725550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.725799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.725915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.726408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.727064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.727064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d555107c-993e-49de-8643-5d1c667ec5de" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.172911] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.627575] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c42e97b4-790e-4c7f-8d9c-081f8539d9bc None None] Enqueued Resource ID: 9e10d562-c5a5-428d-840f-59cad7aba333 with Priority: HIGHEST for action port [ 653.628164] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10d562-c5a5-428d-840f-59cad7aba333 with Priority: HIGHEST for action port [ 653.628548] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e10d562-c5a5-428d-840f-59cad7aba333 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.628924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e10d562-c5a5-428d-840f-59cad7aba333" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.628924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e10d562-c5a5-428d-840f-59cad7aba333" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.629221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e10d562-c5a5-428d-840f-59cad7aba333" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.629221] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e10d562-c5a5-428d-840f-59cad7aba333',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.673580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.674035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.674035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.674035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.674204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.674253] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e is going to be created. [ 653.703264] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.703264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.703264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.704091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.704091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.715441] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e in Status: UNINITIALIZED for 2s [ 653.790433] env[65660]: INFO networking_nsxv3.common.synchronization [None req-35a6e7bc-6059-4587-8a4e-d4c288ce3cfb None None] Enqueued Resource ID: bc8c313b-da85-4cc9-b9bf-06e23c472e4f with Priority: HIGHEST for action port [ 653.790433] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc8c313b-da85-4cc9-b9bf-06e23c472e4f with Priority: HIGHEST for action port [ 653.790764] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc8c313b-da85-4cc9-b9bf-06e23c472e4f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.790930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc8c313b-da85-4cc9-b9bf-06e23c472e4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.791028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc8c313b-da85-4cc9-b9bf-06e23c472e4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.791240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc8c313b-da85-4cc9-b9bf-06e23c472e4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.791362] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc8c313b-da85-4cc9-b9bf-06e23c472e4f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.133564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e10d562-c5a5-428d-840f-59cad7aba333 [ 654.133564] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.133564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.133564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.133564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.133564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.133564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e10d562-c5a5-428d-840f-59cad7aba333 already deleted. [ 654.133564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e10d562-c5a5-428d-840f-59cad7aba333" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.296912] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc8c313b-da85-4cc9-b9bf-06e23c472e4f [ 654.296912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.296912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.296912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.296912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.296912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.296912] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc8c313b-da85-4cc9-b9bf-06e23c472e4f already deleted. [ 654.296912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc8c313b-da85-4cc9-b9bf-06e23c472e4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.336663] env[65660]: INFO networking_nsxv3.common.synchronization [req-5256abdd-e6ea-41bb-8914-6d4e80ea7299 req-7d20c322-886d-4d46-b201-f907ff2bef42 tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 with Priority: HIGHEST for action security_group_rules [ 655.337262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 with Priority: HIGHEST for action security_group_rules [ 655.337595] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.337778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.337862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.342140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.342693] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.730043] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e in Status: SUCCESS [ 655.730043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.730272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.730379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.730581] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.730701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.730761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.731257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.731257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.731257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.731257] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.766658] env[65660]: INFO networking_nsxv3.common.synchronization [req-45931c54-7e8c-40b1-9317-f1d411ab0f0f req-51ddd343-ca9e-45cc-b48c-931c5c834573 tempest-ListServerFiltersTestJSON-1195138828 tempest-ListServerFiltersTestJSON-1195138828-project-member] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 655.767230] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 655.767819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.767975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.767975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.768246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.768435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.768629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.768629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.768953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.768953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.768953] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.867670] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.869052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.869052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.869052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.869052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.869052] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 already deleted. [ 655.869052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.202980] env[65660]: INFO networking_nsxv3.common.synchronization [req-236c5c48-7f74-48e3-a3b2-fb9b1606db1d req-52c34942-ad0e-458b-9a29-cbe0a7b0c50b tempest-InstanceActionsTestJSON-396381560 tempest-InstanceActionsTestJSON-396381560-project-member] Enqueued Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_members [ 656.203597] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGHEST for action security_group_members [ 656.203942] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.204104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.204200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.204456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.204706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.204836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.204927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.205167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.205261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.205356] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.238021] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.273255] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.273480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.273540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.273816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.273944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.274133] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.274223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.274362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.274475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.274541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.274608] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 already deleted. [ 656.274701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.537269] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b06f1ce6-e050-4678-8a58-6eb0a426809c None None] Enqueued Resource ID: d7c8193a-a939-4b03-bfbf-6a1085233fc3 with Priority: HIGHEST for action port [ 656.537888] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c8193a-a939-4b03-bfbf-6a1085233fc3 with Priority: HIGHEST for action port [ 656.538570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7c8193a-a939-4b03-bfbf-6a1085233fc3 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.538570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7c8193a-a939-4b03-bfbf-6a1085233fc3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.538798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7c8193a-a939-4b03-bfbf-6a1085233fc3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.539077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7c8193a-a939-4b03-bfbf-6a1085233fc3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.539194] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7c8193a-a939-4b03-bfbf-6a1085233fc3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.612088] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.612418] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.612889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.613454] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.614654] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.614654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.614654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.614654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.614654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.615326] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.615576] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.615694] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.615842] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.615973] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.616090] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.616221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.637661] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.637661] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.637904] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.637904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.638238] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-38c6214e-7919-43f5-9782-551849b670cc taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.638409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.638519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.639285] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.639530] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38c6214e-7919-43f5-9782-551849b670cc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.708529] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.708749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.708857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.709081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.709210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.709455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.709579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.709686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.709842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.709923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.710036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a is going to be updated. [ 656.740290] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f0605a5-c443-4058-aec5-d5357dce9d2e: rpc.has_security_group_logging(os_id): False [ 656.743178] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.743375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.743375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.743573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.743716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.756509] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a in Status: IN_PROGRESS for 2s [ 656.766482] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.766698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.766737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.766938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.767330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.767330] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.767489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.767489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.767725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.767725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.767818] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e is going to be created. [ 656.835253] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.835253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.835253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.836800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.836800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.852728] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e in Status: IN_PROGRESS for 2s [ 657.042505] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7c8193a-a939-4b03-bfbf-6a1085233fc3 [ 657.042667] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.043703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.043703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.043703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.043703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.043703] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7c8193a-a939-4b03-bfbf-6a1085233fc3 already deleted. [ 657.043703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7c8193a-a939-4b03-bfbf-6a1085233fc3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.143719] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.143719] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.143719] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.144440] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.144440] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.144534] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 38c6214e-7919-43f5-9782-551849b670cc not found, creating... [ 657.145018] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.145018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.145232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.145300] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.146448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.146448] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.146448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.146448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.146448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.146448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.146448] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 38c6214e-7919-43f5-9782-551849b670cc is going to be created. [ 657.168707] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.169851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.169851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.169851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.169851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.169851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.264176] env[65660]: INFO networking_nsxv3.common.synchronization [None req-4a23778f-3cd3-4295-8993-8db93d7af463 None None] Enqueued Resource ID: 59e784c0-6786-4f3b-bed0-8da8282b185a with Priority: HIGHEST for action port [ 657.264713] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e784c0-6786-4f3b-bed0-8da8282b185a with Priority: HIGHEST for action port [ 657.266300] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-59e784c0-6786-4f3b-bed0-8da8282b185a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.266300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59e784c0-6786-4f3b-bed0-8da8282b185a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.266300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59e784c0-6786-4f3b-bed0-8da8282b185a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.266300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59e784c0-6786-4f3b-bed0-8da8282b185a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.266300] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59e784c0-6786-4f3b-bed0-8da8282b185a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.518707] env[65660]: INFO networking_nsxv3.common.synchronization [req-9b8dfea0-041d-43c9-8f06-9cc20ebf659d req-40c59bda-3aef-4ba9-aa37-6c4f8931f3d5 tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 657.519494] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 657.519847] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.519980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.520064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.520369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.520548] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.520659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.520714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.520839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.520922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.521034] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.745781] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c55b3a93-efd0-45a0-b93a-35f7c5db5e11 None None] Enqueued Resource ID: 78585b54-e02d-433f-9525-a82dae86b379 with Priority: HIGHEST for action port [ 657.745781] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78585b54-e02d-433f-9525-a82dae86b379 with Priority: HIGHEST for action port [ 657.745781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-78585b54-e02d-433f-9525-a82dae86b379 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.745781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78585b54-e02d-433f-9525-a82dae86b379" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.745781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78585b54-e02d-433f-9525-a82dae86b379" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.748430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78585b54-e02d-433f-9525-a82dae86b379" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.748529] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78585b54-e02d-433f-9525-a82dae86b379',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.768187] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59e784c0-6786-4f3b-bed0-8da8282b185a [ 657.768187] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.769293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.769357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.770167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.770167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.770167] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59e784c0-6786-4f3b-bed0-8da8282b185a already deleted. [ 657.770167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59e784c0-6786-4f3b-bed0-8da8282b185a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.023631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.023826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.023909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.024162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.024251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.024435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.024588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.024588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.024731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.024855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.024914] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b already deleted. [ 658.024982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.078069] env[65660]: INFO networking_nsxv3.common.synchronization [req-45931c54-7e8c-40b1-9317-f1d411ab0f0f req-6e1b1dbb-9f17-4bef-8167-72a8e2db8120 service nova] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_rules [ 658.078069] env[65660]: INFO networking_nsxv3.common.synchronization [req-45931c54-7e8c-40b1-9317-f1d411ab0f0f req-6e1b1dbb-9f17-4bef-8167-72a8e2db8120 service nova] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 658.078069] env[65660]: INFO networking_nsxv3.common.synchronization [req-45931c54-7e8c-40b1-9317-f1d411ab0f0f req-6e1b1dbb-9f17-4bef-8167-72a8e2db8120 service nova] Enqueued Resource ID: 38c6214e-7919-43f5-9782-551849b670cc with Priority: HIGHEST for action port [ 658.078069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_rules [ 658.078069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 658.078069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c6214e-7919-43f5-9782-551849b670cc with Priority: HIGHEST for action port [ 658.079554] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.079959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.080218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.080606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.080824] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.083305] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.083491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.084077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.084362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.084635] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.084821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.084903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.085134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.085412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.085580] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.087640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-38c6214e-7919-43f5-9782-551849b670cc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.087640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.087640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.087640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.087640] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38c6214e-7919-43f5-9782-551849b670cc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.149917] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.149917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.149917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.149917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.150260] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.150260] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.150260] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.150540] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.151089] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.151089] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.151089] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.151089] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.151304] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.151304] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.151498] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.152828] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.171976] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.172166] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.174052] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.174052] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.174052] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.174052] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.174473] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.174967] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.175141] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a94b6a1-2caa-4af6-9d70-f9608ceecef3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.252144] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78585b54-e02d-433f-9525-a82dae86b379 [ 658.252144] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.252144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.252144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.252578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.252578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.252578] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78585b54-e02d-433f-9525-a82dae86b379 already deleted. [ 658.252578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78585b54-e02d-433f-9525-a82dae86b379" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.576303] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c5e7a600-b0e2-40f1-b0e0-979b4f54f158 tempest-ServersTestManualDisk-1744811056 tempest-ServersTestManualDisk-1744811056-project-member] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_rules [ 658.577104] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_rules [ 658.577563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.577761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.577849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.578222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.578327] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.583430] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.583499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.587294] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.588906] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38c6214e-7919-43f5-9782-551849b670cc with status ACTIVE [ 658.589480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.589480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.589480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.589794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.590447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.590447] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.590447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.592158] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.592158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.592158] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38c6214e-7919-43f5-9782-551849b670cc is going to be updated. [ 658.616014] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.616014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.616014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.616014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.616014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.616014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38c6214e-7919-43f5-9782-551849b670cc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.680023] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.680023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.680023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.680023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.680023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.680023] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 9a94b6a1-2caa-4af6-9d70-f9608ceecef3 not found, creating... [ 658.680466] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.680466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.680466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.680691] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.680747] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.681021] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.681199] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.681317] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.681657] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.681788] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.684066] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 9a94b6a1-2caa-4af6-9d70-f9608ceecef3 is going to be created. [ 658.712534] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.712782] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.712900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.713191] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.713416] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.713633] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.772794] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a in Status: SUCCESS [ 658.773333] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a deletion is rescheduled due to dependency. [ 658.773333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.867193] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e in Status: SUCCESS [ 658.867352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.892161] env[65660]: INFO networking_nsxv3.common.synchronization [None req-3e9b58b6-e204-416e-9a1e-584daeb64619 tempest-ServersTestManualDisk-1744811056 tempest-ServersTestManualDisk-1744811056-project-member] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_rules [ 658.893180] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_rules [ 658.893249] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.893359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.089942] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.102945] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.103524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.103684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.103963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.104126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.104278] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 already deleted. [ 659.104419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.104628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.104836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.104963] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.134919] env[65660]: INFO networking_nsxv3.common.synchronization [None req-977fbf0a-3d4f-46d0-a7db-86d66c78f8d4 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_rules [ 659.135728] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_rules [ 659.136102] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.136239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.136536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.136769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.136852] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.429990] env[65660]: INFO networking_nsxv3.common.synchronization [req-9b8dfea0-041d-43c9-8f06-9cc20ebf659d req-825bf9ad-1f04-4dd8-8e12-a5c91799d29c service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 659.430219] env[65660]: INFO networking_nsxv3.common.synchronization [req-9b8dfea0-041d-43c9-8f06-9cc20ebf659d req-825bf9ad-1f04-4dd8-8e12-a5c91799d29c service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 659.430802] env[65660]: INFO networking_nsxv3.common.synchronization [req-9b8dfea0-041d-43c9-8f06-9cc20ebf659d req-825bf9ad-1f04-4dd8-8e12-a5c91799d29c service nova] Enqueued Resource ID: 9a94b6a1-2caa-4af6-9d70-f9608ceecef3 with Priority: HIGHEST for action port [ 659.430880] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 659.431018] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 659.431272] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a94b6a1-2caa-4af6-9d70-f9608ceecef3 with Priority: HIGHEST for action port [ 659.431605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.431716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.431785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.432057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.432150] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.434032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.434032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.434032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.434242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.434407] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.434509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.434572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.434721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.434806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.434896] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.436066] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.436349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.436349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.436470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.436470] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a94b6a1-2caa-4af6-9d70-f9608ceecef3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.592937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.592937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.592937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.593486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.593486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.593486] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be created. [ 659.627790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.628029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.628029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.628270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.628443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.630568] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.630741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.630741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.631044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.631044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.631204] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 already deleted. [ 659.631204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.642947] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: UNINITIALIZED for 2s [ 659.647857] env[65660]: INFO networking_nsxv3.common.synchronization [None req-0616148f-0ad4-4a59-a548-2e61b30b5186 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_rules [ 659.648443] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_rules [ 659.649167] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.649167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.660273] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.660426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.660497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.660744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.661123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.661123] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 already deleted. [ 659.661123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.661265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.661357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.661457] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.935283] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.935283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.939528] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.941300] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a94b6a1-2caa-4af6-9d70-f9608ceecef3 with status ACTIVE [ 659.941300] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.941300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.941300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.942867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.942867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.942867] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.942867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.942867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.942867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.942867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.945810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.945810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.945810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.945810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.945810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.946234] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a94b6a1-2caa-4af6-9d70-f9608ceecef3 is going to be updated. [ 659.970473] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.970744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.970885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.971291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.972331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.972331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a94b6a1-2caa-4af6-9d70-f9608ceecef3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.186633] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.187008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.187008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.187131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.187131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.187210] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 already deleted. [ 660.187635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.449169] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.453115] env[65660]: INFO networking_nsxv3.common.synchronization [None req-664a4618-3b3c-45a9-b42f-bebb75361e82 None None] Enqueued Resource ID: 20b3adf3-1d4b-4b6e-9d62-2977becb4cdd with Priority: HIGHEST for action port [ 660.453931] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20b3adf3-1d4b-4b6e-9d62-2977becb4cdd with Priority: HIGHEST for action port [ 660.454557] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-20b3adf3-1d4b-4b6e-9d62-2977becb4cdd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.454797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20b3adf3-1d4b-4b6e-9d62-2977becb4cdd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.455325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20b3adf3-1d4b-4b6e-9d62-2977becb4cdd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.455428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20b3adf3-1d4b-4b6e-9d62-2977becb4cdd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.455661] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b3adf3-1d4b-4b6e-9d62-2977becb4cdd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.952670] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.956517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.956517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.956663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.956663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.956801] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be created. [ 660.958478] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20b3adf3-1d4b-4b6e-9d62-2977becb4cdd [ 660.958478] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.958654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.958654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.959589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.959589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.959589] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20b3adf3-1d4b-4b6e-9d62-2977becb4cdd already deleted. [ 660.959589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20b3adf3-1d4b-4b6e-9d62-2977becb4cdd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.985576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.985830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.985830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.986201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.986369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.998402] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: UNINITIALIZED for 2s [ 661.167880] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2a393d93-f7a2-4457-b57f-e3208f2bf846 tempest-ServerActionsV293TestJSON-91498199 tempest-ServerActionsV293TestJSON-91498199-project-member] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_rules [ 661.168297] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_rules [ 661.168630] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.168752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.168814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.169888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.169985] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.281062] env[65660]: INFO networking_nsxv3.common.synchronization [None req-fce65eaa-a4db-497c-8a35-f3b5273d10ab tempest-ServersTestFqdnHostnames-1596316355 tempest-ServersTestFqdnHostnames-1596316355-project-member] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_rules [ 661.281062] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_rules [ 661.281531] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.281531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.281531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.281755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.281837] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.285237] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ec148062-6b73-413d-9eea-39ad7c44a0f2 tempest-ServerActionsV293TestJSON-91498199 tempest-ServerActionsV293TestJSON-91498199-project-member] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_rules [ 661.285922] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_rules [ 661.286207] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.286207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.404563] env[65660]: INFO networking_nsxv3.common.synchronization [None req-3a782947-5eb0-47e8-bc52-146196fe7b93 tempest-ServersTestFqdnHostnames-1596316355 tempest-ServersTestFqdnHostnames-1596316355-project-member] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_rules [ 661.404563] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_rules [ 661.404563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.404563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.494927] env[65660]: INFO networking_nsxv3.common.synchronization [req-06e31d45-a644-4ca4-8b0c-7ee587f57958 req-c22400e2-ed77-40db-bf36-f673743ac12b tempest-SecurityGroupRulesNegativeTestJSON-459586669 tempest-SecurityGroupRulesNegativeTestJSON-459586669-project-member] Enqueued Resource ID: ca68946d-0b2d-49ba-8b53-c88bd10af406 with Priority: HIGHEST for action security_group_rules [ 661.495764] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca68946d-0b2d-49ba-8b53-c88bd10af406 with Priority: HIGHEST for action security_group_rules [ 661.496077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca68946d-0b2d-49ba-8b53-c88bd10af406 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.496202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.496269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.496513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.496595] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca68946d-0b2d-49ba-8b53-c88bd10af406',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.653156] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 661.653407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.653581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.653809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.654015] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.654365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.654365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.654365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.654503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.654503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.654601] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.692028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.692122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.692204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.692424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.692516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.692738] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a already deleted. [ 661.692738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.692896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.693952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.693952] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.805123] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.805310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.805357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.805561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.805660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.805752] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 already deleted. [ 661.805835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.805991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.806156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.806238] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.025043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.025043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.025043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.025043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.025043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.025043] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca68946d-0b2d-49ba-8b53-c88bd10af406 already deleted. [ 662.025807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.157927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.158136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.158136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.158367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.158651] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.158827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.159024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.159329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.159608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.159749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.160173] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.160259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.160425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.160673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.160955] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.162214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.162335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.162628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.162715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.162808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.162908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.219961] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.220272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.220389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.220700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.220948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.221134] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a already deleted. [ 662.221305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.335629] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.335629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.335854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.336202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.336202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.336357] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 already deleted. [ 662.336357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.670428] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82: rpc.has_security_group_logging(os_id): False [ 662.691739] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.691953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.691953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.692147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.692147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.692340] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.692545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.692545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.692667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.692933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.693016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.693112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.693112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.693245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.693318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.693511] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.693601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.693676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.693844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.694028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.694028] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be created. [ 662.708285] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 662.708285] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 662.708823] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 662.708970] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 662.709293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.709363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.709469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.709765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.709878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.709963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.709963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.711307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.711504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.711553] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.713115] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.713115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.713115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.713115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.713353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.713353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.713490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.713531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.713829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.713829] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.756131] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.756131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.756285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.756659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.756659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.765597] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 662.765597] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 662.765597] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_rules [ 662.765597] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 662.765597] env[65660]: INFO networking_nsxv3.common.synchronization [req-91308c4c-c414-46df-85a6-c063f2af4b5f req-52d58caf-4c58-4e6d-8143-0080787559ef tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with Priority: HIGHEST for action port [ 662.767069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 662.767069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_rules [ 662.767069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with Priority: HIGHEST for action port [ 662.767069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 662.767069] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 662.767937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.767937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.767937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.767937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.767937] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.772561] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.772561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.772561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.772788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.773843] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.780104] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-73db27ba-2f7b-4f0d-b9df-1221ea19d193 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.780104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.780104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.780104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.780104] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73db27ba-2f7b-4f0d-b9df-1221ea19d193',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.780104] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.780104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.780104] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.780104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.780104] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 663.010144] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 663.010362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.010520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.010910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.011040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.011111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.011149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.011310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.011431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.011752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.011862] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.218662] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.218662] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.279030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with status ACTIVE [ 663.279193] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.279387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.279387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.279607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.279736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.279942] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.280055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.280118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.280277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.280357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.280646] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.280646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.280807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.280918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.280918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.280992] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 is going to be updated. [ 663.285387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.285521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.286126] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.286278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.317770] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.317925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.317997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.318214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.318360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.318513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.466273] env[65660]: INFO networking_nsxv3.common.synchronization [req-8f06fe15-5beb-4272-836a-e1f7af67ee03 req-d2216356-197d-4845-91a9-26123659c54f tempest-SecurityGroupRulesTestJSON-1192462388 tempest-SecurityGroupRulesTestJSON-1192462388-project-member] Enqueued Resource ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 with Priority: HIGHEST for action security_group_rules [ 663.466955] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 with Priority: HIGHEST for action security_group_rules [ 663.467349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.467580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.467652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.467861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.467940] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.516677] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.516909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.516909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.517172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.517380] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.517524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.517593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.517785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.519393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.519393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.519393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.519393] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.719461] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.727928] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.991388] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.991608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.991673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.991891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.991981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.992132] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38 already deleted. [ 663.992244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4b43ed-38b0-49e2-8a26-a5dfe53ffd38" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.021779] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da44bcac-8dcd-43ae-b931-eee44940a29b: rpc.has_security_group_logging(os_id): False [ 664.042215] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.042365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.042604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.042845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.042963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.043235] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.043347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.043412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.043580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.043661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.043865] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.043972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.044156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.044313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.044393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.044580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.044677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.044736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.044879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.044955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.045054] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be created. [ 664.105784] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.106028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.106082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.106271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.106462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.118485] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 664.222463] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.222947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.222947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.222947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.223117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.223154] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be created. [ 664.232546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.232546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.232762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.232977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.233210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.233387] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 664.255441] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.255628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.255628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.255831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.256103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.264489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.264677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.264677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.264815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.265375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.266818] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: UNINITIALIZED for 2s [ 664.275821] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 664.792984] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 664.793354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.166997] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 665.166997] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 665.166997] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_members [ 665.166997] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 665.166997] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 665.166997] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_members [ 665.166997] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.166997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.167874] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.167874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.167874] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.167874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.167874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.167874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.168151] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.168151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.168247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.169150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.169150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.169150] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.229478] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_rules [ 665.229832] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_members [ 665.230195] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 665.230414] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 665.230612] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_rules [ 665.230859] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 665.231000] env[65660]: INFO networking_nsxv3.common.synchronization [req-097938c2-692b-4e5f-b656-608d88714b35 req-3a4d70f4-8894-4f7b-8b1b-a5f2fd10824a tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with Priority: HIGHEST for action port [ 665.231686] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_rules [ 665.231773] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 665.231885] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 665.231989] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with Priority: HIGHEST for action port [ 665.232094] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_rules [ 665.232180] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_members [ 665.232270] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 665.232578] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.232711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.232774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.233550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.233550] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.234012] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.234115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.234628] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.234709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.234904] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-73db27ba-2f7b-4f0d-b9df-1221ea19d193 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.235013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.235077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.235308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.235393] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73db27ba-2f7b-4f0d-b9df-1221ea19d193',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.236586] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.236586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.236776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.236847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.237044] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.237126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.670800] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.723304] env[65660]: INFO networking_nsxv3.common.synchronization [req-17f6fde2-76fa-499a-aa6a-4f7798f36e3f req-42804d2d-59d4-44cf-a6f0-bf09f444781d tempest-ServerGroupTestJSON-1576129603 tempest-ServerGroupTestJSON-1576129603-project-member] Enqueued Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_members [ 665.724125] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_members [ 665.724490] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.724623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.724681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.724975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.725234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.725356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.725416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.725565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.725838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.725838] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.741086] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73db27ba-2f7b-4f0d-b9df-1221ea19d193 with status ACTIVE [ 665.741086] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.741086] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.741086] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.741086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.741086] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73db27ba-2f7b-4f0d-b9df-1221ea19d193 is going to be updated. [ 665.744049] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.744049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.777605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.778012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.778625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.778915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.779128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.779392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73db27ba-2f7b-4f0d-b9df-1221ea19d193" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.134701] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 666.134701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.177214] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.230889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.230889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.230889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.230889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.230889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.231507] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.231507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.231507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.235019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.235019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.235019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d already deleted. [ 666.235019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.281926] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: UNINITIALIZED for 4s [ 666.286918] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 666.286918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.286918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.286918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.286918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.287296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.287296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.287296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.287396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.287430] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.513921] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.514311] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-422" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.514393] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-422" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.514805] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-422" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.515260] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.515565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.515725] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.515983] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.516146] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.516388] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.516525] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.516635] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.516748] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.516841] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.516942] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.517133] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.542398] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.542398] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.542398] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.542398] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-422" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.542398] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-79dea776-dd0e-4e45-93a2-b6f6aa71e223 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.542398] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.542398] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.542398] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.542398] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79dea776-dd0e-4e45-93a2-b6f6aa71e223',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.678948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.679070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.679118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.679990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.679990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.679990] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 is going to be created. [ 666.715024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.715024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.715024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.715024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.715024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.727098] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: UNINITIALIZED for 2s [ 666.790857] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.045376] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.045722] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.045888] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.046269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.046461] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.046654] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 79dea776-dd0e-4e45-93a2-b6f6aa71e223 not found, creating... [ 667.047079] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.047307] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.047438] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.047780] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.047965] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.048388] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.048600] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.048760] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.049071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.049250] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.049484] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 79dea776-dd0e-4e45-93a2-b6f6aa71e223 is going to be created. [ 667.076507] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.076788] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.076895] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.077315] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.077660] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.077858] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.448812] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.821885] env[65660]: INFO networking_nsxv3.common.synchronization [req-17f6fde2-76fa-499a-aa6a-4f7798f36e3f req-275f60b5-f03b-4cf2-83d2-cd2f85917676 service nova] Enqueued Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_rules [ 667.821885] env[65660]: INFO networking_nsxv3.common.synchronization [req-17f6fde2-76fa-499a-aa6a-4f7798f36e3f req-275f60b5-f03b-4cf2-83d2-cd2f85917676 service nova] Enqueued Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_members [ 667.821885] env[65660]: INFO networking_nsxv3.common.synchronization [req-17f6fde2-76fa-499a-aa6a-4f7798f36e3f req-275f60b5-f03b-4cf2-83d2-cd2f85917676 service nova] Enqueued Resource ID: 79dea776-dd0e-4e45-93a2-b6f6aa71e223 with Priority: HIGHEST for action port [ 667.826083] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_rules [ 667.826083] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_members [ 667.826083] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79dea776-dd0e-4e45-93a2-b6f6aa71e223 with Priority: HIGHEST for action port [ 667.826083] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.826083] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.826083] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.826083] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.826083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.827568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.827823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.827962] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.828973] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-79dea776-dd0e-4e45-93a2-b6f6aa71e223 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.829135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.829189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.829354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.829443] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79dea776-dd0e-4e45-93a2-b6f6aa71e223',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.952819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.953796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.953796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.953935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.953973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.954172] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 667.996325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.996477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.996534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.996732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.996875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.008664] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 668.292843] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 668.292843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.292843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.292843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.292843] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.293202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.293202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.293301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.293390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.293671] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.331242] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.333771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.333771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.335100] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79dea776-dd0e-4e45-93a2-b6f6aa71e223 with status ACTIVE [ 668.335100] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.335100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.335473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.335895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.335956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.336656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.336656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.336656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.337161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.337161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.337350] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.337495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.337598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.337837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.337963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.338120] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79dea776-dd0e-4e45-93a2-b6f6aa71e223 is going to be updated. [ 668.366500] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.366745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.366825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.367090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.367238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.367425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79dea776-dd0e-4e45-93a2-b6f6aa71e223" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.478762] env[65660]: INFO networking_nsxv3.common.synchronization [req-c8eb5608-9f90-418f-a43c-3df882ae3fa4 req-3f12aae6-d6f2-4ce3-942c-34affeab5ef8 tempest-ListServerFiltersTestJSON-1195138828 tempest-ListServerFiltersTestJSON-1195138828-project-member] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 668.479513] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 668.479863] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.480047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.480168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.480580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.480580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.480787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.480787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.480997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.480997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.480997] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.740565] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: SUCCESS [ 668.740926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.743643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.743643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.743643] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.743643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.743643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.743643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.743643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.743643] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.796908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.835753] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.985225] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.208645] env[65660]: INFO networking_nsxv3.common.synchronization [None req-29bcc534-ba12-4383-98b9-c69c8a22a971 None None] Enqueued Resource ID: 4656e66a-209e-47e8-8c67-0efbc604159d with Priority: HIGHEST for action port [ 669.210989] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4656e66a-209e-47e8-8c67-0efbc604159d with Priority: HIGHEST for action port [ 669.211623] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4656e66a-209e-47e8-8c67-0efbc604159d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.212993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4656e66a-209e-47e8-8c67-0efbc604159d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.212993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4656e66a-209e-47e8-8c67-0efbc604159d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.212993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4656e66a-209e-47e8-8c67-0efbc604159d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.212993] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4656e66a-209e-47e8-8c67-0efbc604159d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.245848] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.300098] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.338776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.339098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.339098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.339479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.339479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.340379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d is going to be created. [ 669.367631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.367793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.367864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.368070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.368237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.384585] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d in Status: UNINITIALIZED for 2s [ 669.405599] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.405825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.405969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.406324] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.406640] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.406875] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.406995] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.407468] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.407646] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.407885] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.408110] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.408291] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.408427] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.408568] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.408783] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.408961] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.432518] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.432518] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.432518] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.432767] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.433092] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.433339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.433503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.434059] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.434648] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd9d1d81-5c23-4073-85cc-4b83eb3288b4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.487147] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.533564] env[65660]: INFO networking_nsxv3.common.synchronization [req-9aff7238-9336-486f-bf68-ec1657a9df53 req-6f2d0cba-3f21-4aed-93a8-35ff35736b0c tempest-SecurityGroupRulesNegativeTestJSON-459586669 tempest-SecurityGroupRulesNegativeTestJSON-459586669-project-member] Enqueued Resource ID: ca68946d-0b2d-49ba-8b53-c88bd10af406 with Priority: HIGHEST for action security_group_rules [ 669.534188] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca68946d-0b2d-49ba-8b53-c88bd10af406 with Priority: HIGHEST for action security_group_rules [ 669.534533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca68946d-0b2d-49ba-8b53-c88bd10af406 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.534629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.534716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.534950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.538021] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca68946d-0b2d-49ba-8b53-c88bd10af406',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.717034] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4656e66a-209e-47e8-8c67-0efbc604159d [ 669.717034] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.717034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.717309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.717356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.717439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.717721] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4656e66a-209e-47e8-8c67-0efbc604159d already deleted. [ 669.717721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4656e66a-209e-47e8-8c67-0efbc604159d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.751309] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.804018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.804208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.804276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.804499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.804588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.804688] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be updated. [ 669.841037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.841037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.841037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.841037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.841037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.851675] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: IN_PROGRESS for 2s [ 669.937792] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.938388] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.938644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.939040] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.939392] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.939663] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port fd9d1d81-5c23-4073-85cc-4b83eb3288b4 not found, creating... [ 669.940085] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.940399] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.940624] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.941019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.942035] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.942035] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.942035] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.942035] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.942334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.942334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.942456] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: fd9d1d81-5c23-4073-85cc-4b83eb3288b4 is going to be created. [ 669.965834] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.966017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.966701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.966701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.966701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.966942] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.989965] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.990165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.990236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.990561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.990561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.990682] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 670.019528] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 670.020943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.021572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.021981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.022066] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.022236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.022384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.022559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.022696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.022805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.022932] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.023998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.024246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.024637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.024637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.024780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.024987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.025123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.025205] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.042530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.042530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.042530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.043143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.043143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.097094] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 670.098671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.098671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.098671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.098904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.099024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.099172] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca68946d-0b2d-49ba-8b53-c88bd10af406 already deleted. [ 670.099317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca68946d-0b2d-49ba-8b53-c88bd10af406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.253842] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.253999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.254545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.254545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.254545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.254545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 is going to be updated. [ 670.285821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.285983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.286069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.286253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.286398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.297858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: IN_PROGRESS for 2s [ 670.528129] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.528438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.528482] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.655189] env[65660]: INFO networking_nsxv3.common.synchronization [req-c8eb5608-9f90-418f-a43c-3df882ae3fa4 req-aaf1bf7f-1446-44b4-abde-4d161b8c1445 service nova] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_rules [ 670.655356] env[65660]: INFO networking_nsxv3.common.synchronization [req-c8eb5608-9f90-418f-a43c-3df882ae3fa4 req-aaf1bf7f-1446-44b4-abde-4d161b8c1445 service nova] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 670.655494] env[65660]: INFO networking_nsxv3.common.synchronization [req-c8eb5608-9f90-418f-a43c-3df882ae3fa4 req-aaf1bf7f-1446-44b4-abde-4d161b8c1445 service nova] Enqueued Resource ID: fd9d1d81-5c23-4073-85cc-4b83eb3288b4 with Priority: HIGHEST for action port [ 670.655734] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_rules [ 670.655858] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 670.655949] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9d1d81-5c23-4073-85cc-4b83eb3288b4 with Priority: HIGHEST for action port [ 670.656841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.656841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.656841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.656996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.656996] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.659178] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.659273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.659458] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.659573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.659636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.659923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.659974] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd9d1d81-5c23-4073-85cc-4b83eb3288b4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.846320] env[65660]: INFO networking_nsxv3.common.synchronization [req-80ec1a8a-1ee2-40b3-84fb-6de55395e913 req-bd33ba2e-55e5-48d4-923c-aa410fc16a7a tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 670.847526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 670.847526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.847526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.847526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.847809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.847809] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.847809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.847965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.848037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.850212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.850212] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.030408] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.111948] env[65660]: INFO networking_nsxv3.common.synchronization [req-4ce654ce-30e9-4754-be51-954c955d9d5b req-b3b412fd-760b-4da7-9cc9-7b04bdf53823 tempest-TenantUsagesTestJSON-27473038 tempest-TenantUsagesTestJSON-27473038-project-member] Enqueued Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_members [ 671.111948] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGHEST for action security_group_members [ 671.111948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.111948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.111948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.111948] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.162485] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.162485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.165014] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd9d1d81-5c23-4073-85cc-4b83eb3288b4 with status ACTIVE [ 671.165227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.165346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.165409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.166084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.166084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.166084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.166084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.166084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.166677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.166677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.166677] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.166677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.166677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.166677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.167076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.167294] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd9d1d81-5c23-4073-85cc-4b83eb3288b4 is going to be updated. [ 671.191570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.191712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.191777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.191986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.192133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.192290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd9d1d81-5c23-4073-85cc-4b83eb3288b4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.207872] env[65660]: INFO networking_nsxv3.common.synchronization [req-99791391-bfba-4700-8a45-a933d8ce48e0 req-3107188d-4fb0-4325-963f-4a3d0fcee69f tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 671.208525] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 671.208873] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.209132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.209221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.210038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.210219] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.210350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.210398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.210555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.210640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.210733] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.233191] env[65660]: INFO networking_nsxv3.common.synchronization [None req-969bd76f-e5a5-433b-b07c-2490001404e7 None None] Enqueued Resource ID: fc8b11e7-df91-4bec-8067-58a7bfe6dc22 with Priority: HIGHEST for action port [ 671.233361] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8b11e7-df91-4bec-8067-58a7bfe6dc22 with Priority: HIGHEST for action port [ 671.233665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc8b11e7-df91-4bec-8067-58a7bfe6dc22 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.233790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc8b11e7-df91-4bec-8067-58a7bfe6dc22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.233848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc8b11e7-df91-4bec-8067-58a7bfe6dc22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.238410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc8b11e7-df91-4bec-8067-58a7bfe6dc22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.238410] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc8b11e7-df91-4bec-8067-58a7bfe6dc22',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.354315] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.356292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.356292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.356292] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be updated. [ 671.398215] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d in Status: SUCCESS [ 671.398215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.398387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.398522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.398765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.398927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.399123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.399835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.399835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.399835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.399835] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.403254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.403483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.403588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.403862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.404000] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.413830] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 671.532804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.533323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.533323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.533419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.533459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.533553] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 671.565419] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.565896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.566053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.566609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.567946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.578058] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 671.616107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.616107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.616107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.616107] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4952419-31e9-43c3-93de-73b6983584c2 is going to be updated. [ 671.715642] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.737975] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.738148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.738197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.738401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.738530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.741417] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc8b11e7-df91-4bec-8067-58a7bfe6dc22 [ 671.741710] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.741850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.741850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.742014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.742108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.742216] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc8b11e7-df91-4bec-8067-58a7bfe6dc22 already deleted. [ 671.742283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc8b11e7-df91-4bec-8067-58a7bfe6dc22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.749476] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4952419-31e9-43c3-93de-73b6983584c2 in Status: IN_PROGRESS for 2s [ 671.807019] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.807656] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.807656] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.807656] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.807864] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.808030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.808838] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.808838] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.808838] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.810031] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.810031] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.810031] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.810031] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.810031] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.810031] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.810031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.836840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.837047] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.837047] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.840317] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.840317] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-954e623b-c4d9-4836-9414-264aa785fd85 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.840317] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.840317] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.840317] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.840317] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954e623b-c4d9-4836-9414-264aa785fd85',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.862437] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 671.862717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.862898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.863134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.863326] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.863444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.863503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.863662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.863744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.863839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.863960] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.864832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.865567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.865795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.865905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.865969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.866132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.866210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.866300] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.902778] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.903040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.903040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.903280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.903458] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.903570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.903650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.903777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.903862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.903964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.904128] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.904230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.904282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.904437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.904570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.904671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.904739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.904878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.904952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.905052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.905153] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.023027] env[65660]: INFO networking_nsxv3.common.synchronization [None req-56fe274e-2596-42e1-959a-a33a82f1b011 None None] Enqueued Resource ID: 3857ab95-8acd-498e-b34f-50d8815be9af with Priority: HIGHEST for action port [ 672.023027] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3857ab95-8acd-498e-b34f-50d8815be9af with Priority: HIGHEST for action port [ 672.023027] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3857ab95-8acd-498e-b34f-50d8815be9af taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.023027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3857ab95-8acd-498e-b34f-50d8815be9af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.023027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3857ab95-8acd-498e-b34f-50d8815be9af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.023027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3857ab95-8acd-498e-b34f-50d8815be9af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.023027] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3857ab95-8acd-498e-b34f-50d8815be9af',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.108803] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 672.109108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.109899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.110332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.110585] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.110761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.110845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.111281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.111429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.111572] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.221820] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.318563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: SUCCESS [ 672.318563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.318563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.318563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.318563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.318563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.318563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.319212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.319212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.319212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.319212] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.342221] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.342606] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.342701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.343050] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.343262] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.343442] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 954e623b-c4d9-4836-9414-264aa785fd85 not found, creating... [ 672.343813] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.344131] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.344301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.345016] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.345016] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.345530] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.345754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.345887] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.346184] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.346325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.346622] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 954e623b-c4d9-4836-9414-264aa785fd85 is going to be created. [ 672.369481] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.370505] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.389950] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.390261] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.390424] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.390720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.391033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.391219] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.407635] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d: rpc.has_security_group_logging(os_id): False [ 672.438023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.438384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.438456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.438690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.439181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.439509] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.439660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.439735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.440288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.440288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.440939] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.441190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.441585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.441693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.441790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.442047] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.442276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.442340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.442509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.442640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.442772] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d is going to be created. [ 672.525991] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3857ab95-8acd-498e-b34f-50d8815be9af [ 672.526406] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.526619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.526619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.526847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.526971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.527077] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3857ab95-8acd-498e-b34f-50d8815be9af already deleted. [ 672.528501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3857ab95-8acd-498e-b34f-50d8815be9af" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.531312] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.531842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.531842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.532258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.532788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.548847] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d in Status: IN_PROGRESS for 2s [ 672.614961] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.724882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.725129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.725129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.725372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.725461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.725563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 672.757991] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.758193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.758267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.758652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.758652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.769171] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 672.825586] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.872626] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.875710] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a92ae96e-10c4-4e29-8e7f-609600f2de2e: rpc.has_security_group_logging(os_id): False [ 672.902765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.902927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.902927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.903298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.903403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.903696] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.903855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.903910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.904087] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.904170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.904276] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be created. [ 672.970269] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.970481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.970572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.970809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.971076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.984136] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: IN_PROGRESS for 2s [ 673.118190] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.149023] env[65660]: INFO networking_nsxv3.common.synchronization [req-99791391-bfba-4700-8a45-a933d8ce48e0 req-e3337d57-457d-4907-aae0-eafc05fcb25c service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 673.149023] env[65660]: INFO networking_nsxv3.common.synchronization [req-99791391-bfba-4700-8a45-a933d8ce48e0 req-e3337d57-457d-4907-aae0-eafc05fcb25c service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 673.149023] env[65660]: INFO networking_nsxv3.common.synchronization [req-99791391-bfba-4700-8a45-a933d8ce48e0 req-e3337d57-457d-4907-aae0-eafc05fcb25c service nova] Enqueued Resource ID: 954e623b-c4d9-4836-9414-264aa785fd85 with Priority: HIGHEST for action port [ 673.150444] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 673.150783] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 673.150991] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e623b-c4d9-4836-9414-264aa785fd85 with Priority: HIGHEST for action port [ 673.151466] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.151688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.151935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.152185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.152344] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.155134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.155134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.155134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-954e623b-c4d9-4836-9414-264aa785fd85 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.155134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.155134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.156091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.156091] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954e623b-c4d9-4836-9414-264aa785fd85',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.288497] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d0d77e2b-d38c-499a-88fe-8e5343cfa852 None None] Enqueued Resource ID: d7f31b34-75c2-464b-a045-aa46f7a466e6 with Priority: HIGHEST for action port [ 673.288904] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7f31b34-75c2-464b-a045-aa46f7a466e6 with Priority: HIGHEST for action port [ 673.289238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7f31b34-75c2-464b-a045-aa46f7a466e6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.289469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7f31b34-75c2-464b-a045-aa46f7a466e6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.289989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7f31b34-75c2-464b-a045-aa46f7a466e6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.289989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7f31b34-75c2-464b-a045-aa46f7a466e6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.290213] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7f31b34-75c2-464b-a045-aa46f7a466e6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.329180] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 384c91ff-3865-47c2-b54a-ade5d4bb5f41: rpc.has_security_group_logging(os_id): False [ 673.352260] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.352260] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.352260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.352260] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 is going to be created. [ 673.376092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.376895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.376895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.376895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.376895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.377154] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be updated. [ 673.406052] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.406191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.406258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.406474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.406667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.417607] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: IN_PROGRESS for 2s [ 673.426190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.426190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.426190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.426190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.426190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.457247] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 673.457247] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb deletion is rescheduled due to dependency. [ 673.457247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.462275] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: IN_PROGRESS for 2s [ 673.588533] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 673.588960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.588960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.589572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.589572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.589572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.589572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.589809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.589809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.589895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.620490] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.620696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.620696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.620915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.620998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.621122] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 673.659379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 954e623b-c4d9-4836-9414-264aa785fd85 with status ACTIVE [ 673.659668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.659804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.659876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.660107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.660193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.660369] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.660464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.660604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.660852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.660852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.661019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.661102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.661169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.661345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.661420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.661514] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 954e623b-c4d9-4836-9414-264aa785fd85 is going to be updated. [ 673.662903] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.663033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.664053] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.664164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.664236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.664338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.664475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.677583] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 673.686033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.686217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.686400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.686458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.686593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.686754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-954e623b-c4d9-4836-9414-264aa785fd85" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.734615] env[65660]: INFO networking_nsxv3.common.synchronization [req-cbefc61a-bdb9-4920-b9cc-7eb1ad8950bc req-6b235316-03d3-4acc-b8dd-e77e1b0eb67a tempest-ListServerFiltersTestJSON-1195138828 tempest-ListServerFiltersTestJSON-1195138828-project-member] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 673.735341] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 673.735562] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.735670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.761340] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4952419-31e9-43c3-93de-73b6983584c2 in Status: SUCCESS [ 673.761634] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4952419-31e9-43c3-93de-73b6983584c2 deletion is rescheduled due to dependency. [ 673.761794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.793016] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7f31b34-75c2-464b-a045-aa46f7a466e6 [ 673.793245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.793380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.793449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.793681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.793774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.793907] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7f31b34-75c2-464b-a045-aa46f7a466e6 already deleted. [ 673.793977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7f31b34-75c2-464b-a045-aa46f7a466e6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.094227] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.186600] env[65660]: INFO networking_nsxv3.common.synchronization [req-624b4fea-3a58-4376-aa75-ec4ec4655af3 req-209fc557-1f5d-4e7e-aba5-d49e5b2232ab tempest-DeleteServersAdminTestJSON-1249113108 tempest-DeleteServersAdminTestJSON-1249113108-project-member] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 674.187581] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGHEST for action security_group_members [ 674.187912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.188125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.188193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.188502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.188662] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.188764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.189047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.189047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.189149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.189215] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.247202] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.247202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.247202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.247202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.247753] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.248580] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.248896] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.249358] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.249827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.250175] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.250418] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.250686] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.250993] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.251288] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.251625] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.251898] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.273988] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.273988] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.273988] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.273988] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-920" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.274458] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.274597] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.274682] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.275049] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.275202] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.561621] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d in Status: SUCCESS [ 674.561974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.598989] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.693217] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.693466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.693579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.693833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.693961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.694188] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.694291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.694351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.694503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.694577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.694665] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be updated. [ 674.722046] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.722046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.722046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.722281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.722281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.730844] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: IN_PROGRESS for 2s [ 674.771943] env[65660]: INFO networking_nsxv3.common.synchronization [None req-e8f73dca-ac9d-4624-8de4-df083d4d106f None None] Enqueued Resource ID: 985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee with Priority: HIGHEST for action port [ 674.773209] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee with Priority: HIGHEST for action port [ 674.774511] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.774511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.774697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.774923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.775128] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.777874] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.778142] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.778332] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.778648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.778861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.779424] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 not found, creating... [ 674.779424] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.779887] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.779887] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.780160] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.780368] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.780721] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.780948] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.781199] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.781601] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.781871] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.782111] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 is going to be created. [ 674.784235] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 674.784486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.785080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.785335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.785573] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.785759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.786074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.786201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.786266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.786416] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.807917] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.808251] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.808427] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.808697] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.808969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.809256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.001032] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 675.001032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.001032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.001377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.001422] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.103123] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.103296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.104417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.104701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.104804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.104908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 675.136931] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.137996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.137996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.137996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.137996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.149746] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 675.278353] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee [ 675.278353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.278353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.278533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.278734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.278734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.278872] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee already deleted. [ 675.278872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-985bf7b0-2651-4bdb-a5e6-1a0fbaa75cee" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.288797] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.431395] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 675.431728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.431922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.435338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.435338] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.435338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.435338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.435338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.435338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.435338] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.474693] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: SUCCESS [ 675.474693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.504745] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.504992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.625633] env[65660]: INFO networking_nsxv3.common.synchronization [req-cbefc61a-bdb9-4920-b9cc-7eb1ad8950bc req-4709bf81-6bf0-4601-b578-1f60a8e08eb7 service nova] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_rules [ 675.625915] env[65660]: INFO networking_nsxv3.common.synchronization [req-cbefc61a-bdb9-4920-b9cc-7eb1ad8950bc req-4709bf81-6bf0-4601-b578-1f60a8e08eb7 service nova] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 675.626700] env[65660]: INFO networking_nsxv3.common.synchronization [req-cbefc61a-bdb9-4920-b9cc-7eb1ad8950bc req-4709bf81-6bf0-4601-b578-1f60a8e08eb7 service nova] Enqueued Resource ID: 21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 with Priority: HIGHEST for action port [ 675.627298] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_rules [ 675.627691] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 675.627691] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 with Priority: HIGHEST for action port [ 675.627808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.627954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.628082] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.628171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.628332] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.628858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.628931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.629177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.629251] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.687820] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 675.689194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.689278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.689465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.689685] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.689802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.689866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.690034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.690165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.690210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.690447] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.692890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.693131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.694649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.694771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.694838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.695016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.695107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.695461] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.790604] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.795249] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d6c8501-2c08-4873-b4dc-b64b2bb74692 req-4c9a21b2-f569-4306-8771-997d63d4301d tempest-ServersTestManualDisk-1744811056 tempest-ServersTestManualDisk-1744811056-project-member] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_members [ 675.795910] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_members [ 675.796090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.796212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.796268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.796735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.796735] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.796861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.796861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.796955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.797465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.797919] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.935837] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.133367] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 with status ACTIVE [ 676.133367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.133367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.133367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.133367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.133367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.133367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.133367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.133964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.133964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.133964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.134444] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.134590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.135111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.135338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.135471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.135592] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97 is going to be updated. [ 676.164033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.164033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.164033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.164033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.164420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.164420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21fc9cfa-47b7-43ab-b6e2-a8d2765e0b97" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.197537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.197714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.197857] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.294366] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.294366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.294366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.294678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.294678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.295323] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 676.299781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.299939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.300036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.300306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.300402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.300572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.300788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.300788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.303096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.303096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.303096] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 already deleted. [ 676.303096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.316803] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-488 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.316952] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-488" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.318052] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-488" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.318052] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-488" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.318861] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.319043] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.321221] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.321221] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.321221] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.321221] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.321221] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.321221] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.321221] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.321221] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.321221] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.321221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.337238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.337407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.337501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.337727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.337926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.348858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.349108] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.349767] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.349767] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-488" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.349862] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-7ffcd12a-df60-4362-93ce-988755509c95 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.350046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.350201] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.350557] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.350879] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffcd12a-df60-4362-93ce-988755509c95',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.354752] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 676.439800] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.703600] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.744538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 in Status: SUCCESS [ 676.744804] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 deletion is rescheduled due to dependency. [ 676.744872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.853735] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.853735] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.853959] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.854809] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.854809] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.854809] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 7ffcd12a-df60-4362-93ce-988755509c95 not found, creating... [ 676.855307] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.855425] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.855617] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.855860] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.855976] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.856472] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.856644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.857042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.857098] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.857203] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.857429] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 7ffcd12a-df60-4362-93ce-988755509c95 is going to be created. [ 676.882102] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.882102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.882102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.882102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.882532] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.882532] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.941521] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.941763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.941830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.942077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.942173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.942273] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be updated. [ 677.004707] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.004862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.004933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.005274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.005426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.019279] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: IN_PROGRESS for 2s [ 677.160134] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 677.160364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.160586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.160858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.161218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.161394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.161492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.161664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.161798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.161952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.162143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.162234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.162296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.162478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.162635] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.162713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.162780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.162967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.163082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.163173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.163265] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.205700] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.205946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.206090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.206350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.206483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.206584] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 677.248502] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.248733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.248919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.249248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.249407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.276022] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 677.494783] env[65660]: INFO networking_nsxv3.common.synchronization [req-632cb568-f468-4b07-8e4a-698387215b42 req-0b06b887-7d56-43b9-a2f3-d06da76cf173 tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 677.496076] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 677.496654] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.496841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.496944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.497258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.497463] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.497597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.497686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.497876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.498010] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.498204] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.665372] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d6c8501-2c08-4873-b4dc-b64b2bb74692 req-61f559b9-6256-44f7-a389-8162f966ab5f service nova] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_rules [ 677.665571] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d6c8501-2c08-4873-b4dc-b64b2bb74692 req-61f559b9-6256-44f7-a389-8162f966ab5f service nova] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_members [ 677.665658] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d6c8501-2c08-4873-b4dc-b64b2bb74692 req-61f559b9-6256-44f7-a389-8162f966ab5f service nova] Enqueued Resource ID: 7ffcd12a-df60-4362-93ce-988755509c95 with Priority: HIGHEST for action port [ 677.665893] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 677.671538] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_rules [ 677.671745] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_members [ 677.671851] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffcd12a-df60-4362-93ce-988755509c95 with Priority: HIGHEST for action port [ 677.672580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.672752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.672821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.673055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.673139] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.674422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.674556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.674610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.674831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.674963] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.676472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.676534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.679587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.679587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.679587] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.679587] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ffcd12a-df60-4362-93ce-988755509c95 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.679587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.679587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.679587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.680779] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffcd12a-df60-4362-93ce-988755509c95',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.703036] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.703036] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.703036] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.703036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.704179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.704179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.705352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.705609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.705700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.705845] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 677.778732] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.779262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.779384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.779765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.779839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.798978] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6783fb09-b8c7-4d4b-a48a-835795989667 None None] Enqueued Resource ID: 81b351eb-e27a-4750-a3aa-981be7bdf4a1 with Priority: HIGHEST for action port [ 677.799995] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 677.800510] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b351eb-e27a-4750-a3aa-981be7bdf4a1 with Priority: HIGHEST for action port [ 677.802160] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-81b351eb-e27a-4750-a3aa-981be7bdf4a1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.802160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81b351eb-e27a-4750-a3aa-981be7bdf4a1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.802160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81b351eb-e27a-4750-a3aa-981be7bdf4a1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.802160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81b351eb-e27a-4750-a3aa-981be7bdf4a1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.802160] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b351eb-e27a-4750-a3aa-981be7bdf4a1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.002969] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.002969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.002969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.002969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.006022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.006022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.006022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.006022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.006022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.006022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.006022] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 678.057466] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.058430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.058430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.058430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.058430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.071270] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 678.182246] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.182521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.184300] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.185653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ffcd12a-df60-4362-93ce-988755509c95 with status ACTIVE [ 678.185653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.185653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.185653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.185998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.185998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.187299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.187299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.187299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.187657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.190621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.190621] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.190621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.190621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.190621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.190621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.190621] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ffcd12a-df60-4362-93ce-988755509c95 is going to be updated. [ 678.228070] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.228207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.228295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.228575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.229058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.230860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ffcd12a-df60-4362-93ce-988755509c95" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.305329] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81b351eb-e27a-4750-a3aa-981be7bdf4a1 [ 678.308530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.308530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.308530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.308530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.308530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.308530] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81b351eb-e27a-4750-a3aa-981be7bdf4a1 already deleted. [ 678.308530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81b351eb-e27a-4750-a3aa-981be7bdf4a1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.365844] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 678.366427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.366924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.367666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.367666] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.367666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.367666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.367944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.367986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.368089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.369086] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.514790] env[65660]: INFO networking_nsxv3.common.synchronization [req-2ffec5c0-7e03-4e9c-b455-2acfeffdc69a req-69d37695-16c2-42c1-af0e-6bb54d631184 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_members [ 678.515547] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_members [ 678.515884] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.516036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.516102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.516369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.516784] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.516901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.516965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.517134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.517277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.517333] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.693508] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.870955] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.871370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.871370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.872522] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.872522] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.872522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.873348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.873348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.874018] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.019123] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.019373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.020017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.020017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.020017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.020199] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.023739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.024408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.028027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.028027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.028027] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 already deleted. [ 679.028027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.038270] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 679.038270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.038270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.038270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.038270] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.038873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.039739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.039739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.039739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.039739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.039739] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.197605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.197883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.197948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.198322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.198322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.198322] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 is going to be created. [ 679.229532] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.229708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.229783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.230069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.230269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.248735] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 in Status: UNINITIALIZED for 2s [ 679.271461] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.271851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.271972] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.272503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.272939] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.273251] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.273376] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.273618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.273767] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.274088] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.274201] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.274305] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.274407] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.274515] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.274651] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.274795] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.292641] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 679.292878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.293543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.293793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.294105] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.294236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.294236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.294363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.294427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.294526] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.304334] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.304678] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.304882] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.305168] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.305624] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-e013c1a8-6fa6-45d7-86e6-2e69520dac99 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.305876] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.306090] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.306509] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.306696] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e013c1a8-6fa6-45d7-86e6-2e69520dac99',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.377445] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da44bcac-8dcd-43ae-b931-eee44940a29b: rpc.has_security_group_logging(os_id): False [ 679.413293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.413552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.413661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.413974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.414149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.414496] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.414663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.414776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.415179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.415370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.415713] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.415929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.416161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.416401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.416583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.416921] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.417152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.417317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.417606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.417790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.417977] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 679.516929] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.517147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.517230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.517601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.517815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.533415] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 679.542402] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.796508] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.810246] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.810543] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.810672] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.810950] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.811109] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.811566] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port e013c1a8-6fa6-45d7-86e6-2e69520dac99 not found, creating... [ 679.811566] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.811767] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.811767] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.812426] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.812426] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.812426] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.813137] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.813282] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.813494] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.813627] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.813763] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: e013c1a8-6fa6-45d7-86e6-2e69520dac99 is going to be created. [ 679.818064] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 679.818064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.818064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.818064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.818064] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.842704] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.842974] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.843201] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.843385] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.843632] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.843861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.045138] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a92ae96e-10c4-4e29-8e7f-609600f2de2e: rpc.has_security_group_logging(os_id): False [ 680.067409] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.067409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.067409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.067667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.067733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.067908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.068029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.068088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.068220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.068297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.068369] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be updated. [ 680.080811] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 680.080969] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 680.081225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.125113] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.125335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.125335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.125535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.125677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.138471] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: IN_PROGRESS for 2s [ 680.300584] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.322108] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.322545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.322545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.322765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.322901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.323021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.323098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.323517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.323517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.323517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.323517] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.434696] env[65660]: INFO networking_nsxv3.common.synchronization [None req-31d1ddde-5034-42a8-ba33-d0d25a1b316f tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 680.436161] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 680.436506] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.436632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.436701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.436973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.437069] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.621924] env[65660]: INFO networking_nsxv3.common.synchronization [req-2ffec5c0-7e03-4e9c-b455-2acfeffdc69a req-b5edc617-b47d-466e-a156-e3814eb2f477 service nova] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_rules [ 680.622036] env[65660]: INFO networking_nsxv3.common.synchronization [req-2ffec5c0-7e03-4e9c-b455-2acfeffdc69a req-b5edc617-b47d-466e-a156-e3814eb2f477 service nova] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_members [ 680.622601] env[65660]: INFO networking_nsxv3.common.synchronization [req-2ffec5c0-7e03-4e9c-b455-2acfeffdc69a req-b5edc617-b47d-466e-a156-e3814eb2f477 service nova] Enqueued Resource ID: e013c1a8-6fa6-45d7-86e6-2e69520dac99 with Priority: HIGHEST for action port [ 680.623526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_rules [ 680.623767] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_members [ 680.623876] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e013c1a8-6fa6-45d7-86e6-2e69520dac99 with Priority: HIGHEST for action port [ 680.624225] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.624356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.624422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.624640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.624724] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.625797] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.625797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.625797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.626262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.626262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.626262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.626262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.626440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.626489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.626663] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.627858] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e013c1a8-6fa6-45d7-86e6-2e69520dac99 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.628013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.628088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.628225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.628302] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e013c1a8-6fa6-45d7-86e6-2e69520dac99',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.783354] env[65660]: INFO networking_nsxv3.common.synchronization [None req-95b1c12c-7280-4df1-a7aa-726bc88f1e7f tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 680.783774] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 680.784164] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.784266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.802575] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.802836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.802933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.804230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.804391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.804480] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 680.829021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.829021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.829021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.829397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.829397] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.829691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.829691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.829822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.829865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.831526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.831526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.831526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.832895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.832895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.847668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.847865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.848074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.848310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.848408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.864499] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 680.964481] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.964671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.966902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.966902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.966902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.966902] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 already deleted. [ 680.966902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.966902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.966902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.966902] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.131738] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.131738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.131738] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.134387] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e013c1a8-6fa6-45d7-86e6-2e69520dac99 with status ACTIVE [ 681.134387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.134387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.134387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.134387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.134387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.134387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.134387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.134387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.135615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.135615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.135615] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.135615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.136128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.136342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.136571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.136571] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e013c1a8-6fa6-45d7-86e6-2e69520dac99 is going to be updated. [ 681.168196] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.168345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.168413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.168628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.168764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.168925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e013c1a8-6fa6-45d7-86e6-2e69520dac99" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.203766] env[65660]: INFO networking_nsxv3.common.synchronization [req-3d39893a-b15b-408f-8c7f-fdedc47ef9a7 req-0a563431-99fe-4b60-8f0a-90942b6a16df tempest-ServersTestFqdnHostnames-1596316355 tempest-ServersTestFqdnHostnames-1596316355-project-member] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_members [ 681.204166] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_members [ 681.204515] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.204515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.204660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.205351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.205561] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.205725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.205798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.205970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.206073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.206513] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.262192] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 in Status: SUCCESS [ 681.262425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.262601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.262941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.263160] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.263335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.263335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.263504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.263588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.263696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.263797] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.336435] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 681.362627] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.362627] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.362627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.366766] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.366766] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.366766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.366766] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 681.458576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.458576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.458576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.458576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.458576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.478109] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 681.494244] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.494244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.494244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.494244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.494244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.494244] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 already deleted. [ 681.494244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.559093] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 681.559196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.640451] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.712465] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.712465] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.712465] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 already deleted. [ 681.712465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.768499] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.779133] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.779328] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.779452] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.779919] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.780147] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.780499] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.780889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.781138] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.781277] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.781470] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.781586] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.782384] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.782564] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.782954] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.783147] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.783288] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.804949] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.805133] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.805568] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.805568] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.805724] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-47f66d3b-2def-4f69-a98d-83a10013d323 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.805896] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.805985] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.806503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.806503] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f66d3b-2def-4f69-a98d-83a10013d323',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.144411] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.144931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.144931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.145066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.145122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.145265] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 is going to be created. [ 682.160142] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 682.160425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.174267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.174457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.174560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.174853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.175104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.186470] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 in Status: UNINITIALIZED for 2s [ 682.273087] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65621639-622d-4f5b-8229-eb6bfdd2fa83: rpc.has_security_group_logging(os_id): False [ 682.297901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.298154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.298235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.298456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.298580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.298867] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.299032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.299109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.299284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.299399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.299575] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 is going to be created. [ 682.309527] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.309724] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.309858] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.310166] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.310310] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.310537] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 47f66d3b-2def-4f69-a98d-83a10013d323 not found, creating... [ 682.310903] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.311104] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.311983] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.311983] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.311983] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.311983] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.312233] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.312233] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.312431] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.312572] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.312863] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 47f66d3b-2def-4f69-a98d-83a10013d323 is going to be created. [ 682.414372] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.414573] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.414703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.415638] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.415938] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.416208] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.546290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.546290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.546485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.546946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.547044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.580416] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 in Status: IN_PROGRESS for 2s [ 682.876170] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 682.876527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.876799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.877139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.877441] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.877619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.877820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.877996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.878158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.878303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.878529] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.878717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.878717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.879087] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.879190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.879359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.879718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.879718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.879835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.880286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.880286] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.139845] env[65660]: INFO networking_nsxv3.common.synchronization [req-3d39893a-b15b-408f-8c7f-fdedc47ef9a7 req-9a4aa8c5-a21f-4864-83d5-490ffa5f25af service nova] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_rules [ 683.139975] env[65660]: INFO networking_nsxv3.common.synchronization [req-3d39893a-b15b-408f-8c7f-fdedc47ef9a7 req-9a4aa8c5-a21f-4864-83d5-490ffa5f25af service nova] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_members [ 683.140053] env[65660]: INFO networking_nsxv3.common.synchronization [req-3d39893a-b15b-408f-8c7f-fdedc47ef9a7 req-9a4aa8c5-a21f-4864-83d5-490ffa5f25af service nova] Enqueued Resource ID: 47f66d3b-2def-4f69-a98d-83a10013d323 with Priority: HIGHEST for action port [ 683.140638] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_rules [ 683.141147] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_members [ 683.141346] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f66d3b-2def-4f69-a98d-83a10013d323 with Priority: HIGHEST for action port [ 683.141560] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.141755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.141755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.141979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.142075] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.142974] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.143130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.143181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.143361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.143509] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.143603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.143754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.143804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.144117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.144117] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.144851] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f66d3b-2def-4f69-a98d-83a10013d323 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.145221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.145221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.145221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.145221] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f66d3b-2def-4f69-a98d-83a10013d323',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.384621] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82: rpc.has_security_group_logging(os_id): False [ 683.405929] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.406096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.408405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.408405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.408405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.408405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.409511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.409511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.409511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.409511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.409511] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 683.494263] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 683.494511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.499814] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.499984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.500102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.500316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.500461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.515897] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 683.649914] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.651238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.651238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.652909] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f66d3b-2def-4f69-a98d-83a10013d323 with status ACTIVE [ 683.652909] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.652909] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.652909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.653531] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.653531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.653531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.653531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.653531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.653705] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f66d3b-2def-4f69-a98d-83a10013d323 is going to be updated. [ 683.680398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.680930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.682023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.682023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.682023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.682445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f66d3b-2def-4f69-a98d-83a10013d323" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.156022] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.198099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 in Status: SUCCESS [ 684.198482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.198780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.199052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.200644] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.200644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.200644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.200644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.200644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.200644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.200644] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.596974] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 in Status: SUCCESS [ 684.596974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.660176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.660428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.660428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.660717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.660821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.660922] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 is going to be created. [ 684.693449] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.693647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.693724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.694342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.694732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.703708] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.709710] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: UNINITIALIZED for 2s [ 685.206489] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef75b626-5ac5-4f1b-bccb-30d1c66c9174: rpc.has_security_group_logging(os_id): False [ 685.227089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.227089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.227089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.227089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.227532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.227532] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.227532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.227532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.227741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.228742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.228742] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 is going to be created. [ 685.305441] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.305539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.305578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.306437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.306437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.326709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 in Status: IN_PROGRESS for 2s [ 685.537900] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 685.538177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.538327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.538560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.538651] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.734715] env[65660]: INFO networking_nsxv3.common.synchronization [None req-90475f8d-4165-43d0-990a-125fb4d061e0 tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1f892695-a3db-4143-977d-f1c9b76afc62 with Priority: HIGHEST for action security_group_rules [ 685.735074] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f892695-a3db-4143-977d-f1c9b76afc62 with Priority: HIGHEST for action security_group_rules [ 685.735428] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f892695-a3db-4143-977d-f1c9b76afc62 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.735567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.735662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.735956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.736158] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f892695-a3db-4143-977d-f1c9b76afc62',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.993267] env[65660]: INFO networking_nsxv3.common.synchronization [None req-cb24a0ab-c02b-402e-bdfd-d6092a01a0f0 tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1f892695-a3db-4143-977d-f1c9b76afc62 with Priority: HIGHEST for action security_group_rules [ 685.994648] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f892695-a3db-4143-977d-f1c9b76afc62 with Priority: HIGHEST for action security_group_rules [ 685.994648] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f892695-a3db-4143-977d-f1c9b76afc62 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.994648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.041526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.041707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.041707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.042521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.042521] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.042521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.042521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.042838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.042838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.042934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.042982] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.263235] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.263584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.263584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.263768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.263815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.263916] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f892695-a3db-4143-977d-f1c9b76afc62 already deleted. [ 686.263979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.264547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.264730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.264846] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f892695-a3db-4143-977d-f1c9b76afc62',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.549551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.549795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.549907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.551251] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.551251] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.551251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.551815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.551815] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.551815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.551815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.551815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.552031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.552071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.552136] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.719221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: SUCCESS [ 686.719464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.719657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.719858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.720059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.720175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.720239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.720395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.720476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.720560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.720656] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.795272] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.795925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.795925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.795925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.795925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.795925] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f892695-a3db-4143-977d-f1c9b76afc62 already deleted. [ 686.796201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f892695-a3db-4143-977d-f1c9b76afc62" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.054757] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82: rpc.has_security_group_logging(os_id): False [ 687.077647] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.077832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.077897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.078090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.078188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.078545] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.078545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.078545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.078854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.078942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.079142] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.079236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.079299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.079438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.079512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.079731] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.079839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.079898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.080124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.080124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.080285] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 687.148196] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.148401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.148401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.148616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.148764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.164489] env[65660]: INFO networking_nsxv3.common.synchronization [req-93a8aa7a-20dc-41b9-aa89-6989b9f0da68 req-9f6551c7-51f5-47f8-845e-42e3f7e9a2de tempest-ListImageFiltersTestJSON-2125792351 tempest-ListImageFiltersTestJSON-2125792351-project-member] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 687.165031] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 687.165348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.165463] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.165524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.165776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.165931] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.166147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.166234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.166389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.166474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.166588] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.168680] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 687.223202] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.340035] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 in Status: SUCCESS [ 687.340035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.554977] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.555326] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.555480] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.556362] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.557250] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.557250] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.557250] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.557250] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.557472] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.557507] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.557616] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.557763] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.557889] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.557999] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.559426] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.559621] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.591619] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.591966] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.592219] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.592717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.592834] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-4368d7be-839b-4301-a380-25f8e632b093 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.593180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.593424] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.594142] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.594230] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4368d7be-839b-4301-a380-25f8e632b093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.669148] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.669351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.669618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.669754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.669862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.670071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.670176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.670240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.670404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.670565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.670679] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 already deleted. [ 687.670765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.726244] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4849bc3-c5eb-4d2a-b87d-61a1b4e18236: rpc.has_security_group_logging(os_id): False [ 687.751738] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.751944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.752031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.752280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.752380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.752736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.752736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.752913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.753260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.753260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.753260] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 is going to be created. [ 687.820010] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.820181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.820258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.820474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.820656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.835586] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: IN_PROGRESS for 2s [ 688.097535] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.098067] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.098067] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.098520] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.098697] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.098891] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 4368d7be-839b-4301-a380-25f8e632b093 not found, creating... [ 688.099181] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.100010] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.100171] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.100712] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.100712] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.101395] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.101512] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.101512] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.101788] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.101902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.102059] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 4368d7be-839b-4301-a380-25f8e632b093 is going to be created. [ 688.130054] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.130054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.130054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.130054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.130054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.130054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.996608] env[65660]: INFO networking_nsxv3.common.synchronization [req-93a8aa7a-20dc-41b9-aa89-6989b9f0da68 req-ef335926-f6f1-411d-857b-9e1332e3472f service nova] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_rules [ 688.996608] env[65660]: INFO networking_nsxv3.common.synchronization [req-93a8aa7a-20dc-41b9-aa89-6989b9f0da68 req-ef335926-f6f1-411d-857b-9e1332e3472f service nova] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 688.998264] env[65660]: INFO networking_nsxv3.common.synchronization [req-93a8aa7a-20dc-41b9-aa89-6989b9f0da68 req-ef335926-f6f1-411d-857b-9e1332e3472f service nova] Enqueued Resource ID: 4368d7be-839b-4301-a380-25f8e632b093 with Priority: HIGHEST for action port [ 688.998264] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_rules [ 688.999295] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 688.999295] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4368d7be-839b-4301-a380-25f8e632b093 with Priority: HIGHEST for action port [ 688.999295] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.000265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.000265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.000265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.000265] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.001176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.001176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.001291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.001396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.001545] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.001636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.001724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.001865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.001951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.004825] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.005423] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4368d7be-839b-4301-a380-25f8e632b093 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.005423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.005423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.006097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.006097] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4368d7be-839b-4301-a380-25f8e632b093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.188350] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 689.188350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.510260] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.510260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.510260] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.510260] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4368d7be-839b-4301-a380-25f8e632b093 with status ACTIVE [ 689.510260] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.510260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.510260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.510516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.510637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.510852] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.511023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.511398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.511442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.511579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.511997] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.511997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.511997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.512219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.512219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.512334] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4368d7be-839b-4301-a380-25f8e632b093 is going to be updated. [ 689.541074] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.541482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.541629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.542048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.542288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4368d7be-839b-4301-a380-25f8e632b093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.850396] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: SUCCESS [ 689.850396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.014439] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.518885] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.521674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.521674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.521674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.521674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.521674] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be created. [ 690.543832] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.544013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.544090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.544334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.544525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.555541] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: UNINITIALIZED for 2s [ 690.606253] env[65660]: INFO networking_nsxv3.common.synchronization [req-b4fa9490-8022-4264-9b4d-6ab285a6cfbe req-8bee08c3-98f0-4aa1-8e14-4db0852d1be2 tempest-ServerGroupTestJSON-1576129603 tempest-ServerGroupTestJSON-1576129603-project-member] Enqueued Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_members [ 690.607105] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGHEST for action security_group_members [ 690.608037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.608037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.608037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.608037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.608656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.608656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.608656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.608762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.609519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.609519] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.113271] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.113633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.113679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.114810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.114810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.114810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.114810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.114810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.116363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.116363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.116363] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d is going to be updated. [ 691.151384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.151579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.151623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.153025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.153025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.164470] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d in Status: IN_PROGRESS for 2s [ 692.568538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 692.569486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.570546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.572327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.572327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.572327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.572327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.572327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.572327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.572327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.572327] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.074983] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.075763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.075763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.075763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.075763] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.075763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.076095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.076095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.076095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.076176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.076425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.076425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.076425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.076553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.076759] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.076759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.076839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.077238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.077238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.077238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.077238] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.175321] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d in Status: SUCCESS [ 693.175613] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d deletion is rescheduled due to dependency. [ 693.175770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.409831] env[65660]: INFO networking_nsxv3.common.synchronization [req-6a228908-c6a8-4459-b2df-c47b809b6f03 req-60ad7c42-e125-412a-92c5-b401778a55c0 tempest-FloatingIPsAssociationNegativeTestJSON-856864171 tempest-FloatingIPsAssociationNegativeTestJSON-856864171-project-member] Enqueued Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_members [ 693.410923] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_members [ 693.411359] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.411586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.411706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.412073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.412855] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.413028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.413157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.413461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.413598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.413736] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.583455] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf0f4a4-4808-4a1d-a832-54c26e813f60: rpc.has_security_group_logging(os_id): False [ 693.605360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.605360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.605360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.605360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.605360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.605360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.605360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.605762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.606042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.606152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.606426] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.606587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.606689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.606879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.607097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.607425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.607667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.607789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.607978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.608123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.608250] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be created. [ 693.682379] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.683030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.683030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.683030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.683201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.697909] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 693.915823] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.915972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.916052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.916276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.916368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.916565] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.916657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.916765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.916911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.917049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.917161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 already deleted. [ 693.917161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.222214] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.222404] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-364" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.222525] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-364" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.222903] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-364" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.223174] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.223330] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.223443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.223661] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.223801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.224011] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.224129] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.224231] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.224333] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.224435] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.224533] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.224656] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.247325] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.247486] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.247616] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.247912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-364" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.248344] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-0d68260b-506c-4055-9f6a-ef2a6f909f61 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.248619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.248770] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.249123] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.249269] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d68260b-506c-4055-9f6a-ef2a6f909f61',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.751226] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.751533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.751598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.751963] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.752217] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.752421] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 0d68260b-506c-4055-9f6a-ef2a6f909f61 not found, creating... [ 694.752681] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.752858] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.752970] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.753202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.753328] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.753637] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.753812] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.753924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.754154] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.754288] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.754429] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 0d68260b-506c-4055-9f6a-ef2a6f909f61 is going to be created. [ 694.775305] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.775498] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.775616] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.775985] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.776351] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.776580] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.810333] env[65660]: INFO networking_nsxv3.common.synchronization [None req-396a5eaf-87eb-407d-8064-68874e8d61b8 None None] Enqueued Resource ID: e7c90806-d11c-46fa-beb4-9b06478119d4 with Priority: HIGHEST for action port [ 694.810964] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c90806-d11c-46fa-beb4-9b06478119d4 with Priority: HIGHEST for action port [ 694.811308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7c90806-d11c-46fa-beb4-9b06478119d4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.811450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7c90806-d11c-46fa-beb4-9b06478119d4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.811519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7c90806-d11c-46fa-beb4-9b06478119d4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.811839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7c90806-d11c-46fa-beb4-9b06478119d4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.811946] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c90806-d11c-46fa-beb4-9b06478119d4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.314710] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7c90806-d11c-46fa-beb4-9b06478119d4 [ 695.315327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.315457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.315555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.315745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.315861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.315965] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7c90806-d11c-46fa-beb4-9b06478119d4 already deleted. [ 695.316303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7c90806-d11c-46fa-beb4-9b06478119d4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.495805] env[65660]: INFO networking_nsxv3.common.synchronization [req-6a228908-c6a8-4459-b2df-c47b809b6f03 req-e6f3c7f1-7d6a-49cf-8810-d913a5f2f68c service nova] Enqueued Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_rules [ 695.495977] env[65660]: INFO networking_nsxv3.common.synchronization [req-6a228908-c6a8-4459-b2df-c47b809b6f03 req-e6f3c7f1-7d6a-49cf-8810-d913a5f2f68c service nova] Enqueued Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_members [ 695.496120] env[65660]: INFO networking_nsxv3.common.synchronization [req-6a228908-c6a8-4459-b2df-c47b809b6f03 req-e6f3c7f1-7d6a-49cf-8810-d913a5f2f68c service nova] Enqueued Resource ID: 0d68260b-506c-4055-9f6a-ef2a6f909f61 with Priority: HIGHEST for action port [ 695.496671] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_rules [ 695.496809] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_members [ 695.496905] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d68260b-506c-4055-9f6a-ef2a6f909f61 with Priority: HIGHEST for action port [ 695.497269] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.497378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.497453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.497649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.497853] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.499246] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.499440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.499556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.499707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.503018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.503018] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.503018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d68260b-506c-4055-9f6a-ef2a6f909f61 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.503018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.503018] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d68260b-506c-4055-9f6a-ef2a6f909f61',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.714219] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 695.714219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.008791] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d68260b-506c-4055-9f6a-ef2a6f909f61 with status ACTIVE [ 696.009040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.009485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.009485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.009651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.009833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.010569] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.010569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.010569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.010569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.010569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.010781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.010781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.010859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.011132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.011132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.011239] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d68260b-506c-4055-9f6a-ef2a6f909f61 is going to be updated. [ 696.012378] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.013527] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.013527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.034798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.034798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.034798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.034798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.034954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.035018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d68260b-506c-4055-9f6a-ef2a6f909f61" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.514458] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.686860] env[65660]: INFO networking_nsxv3.common.synchronization [req-340e18c4-6b18-4839-87a2-03026d364737 req-c4c540eb-d7c1-48ab-be81-8038d2dbfdd0 tempest-ListImageFiltersTestJSON-2125792351 tempest-ListImageFiltersTestJSON-2125792351-project-member] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 696.687437] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 696.687743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.687864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.687932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.688315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.688491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.688594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.688656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.688818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.688906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.689146] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.018426] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.018674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.018674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.018863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.019074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.019176] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 is going to be created. [ 697.042995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.043147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.043503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.043503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.043680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.057047] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 in Status: UNINITIALIZED for 2s [ 697.097037] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.097257] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.097380] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.097669] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.097955] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.098207] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.098325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.098539] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.098677] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.098876] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.098984] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.099117] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.099251] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.099371] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.099477] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.099607] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.105931] env[65660]: INFO networking_nsxv3.common.synchronization [None req-8114f53a-7c1c-4bd3-9f23-b8f1233622cd None None] Enqueued Resource ID: 2971b203-f109-457d-a98a-7d16ad35d1ba with Priority: HIGHEST for action port [ 697.106210] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2971b203-f109-457d-a98a-7d16ad35d1ba with Priority: HIGHEST for action port [ 697.106723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2971b203-f109-457d-a98a-7d16ad35d1ba taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.106845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2971b203-f109-457d-a98a-7d16ad35d1ba" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.106929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2971b203-f109-457d-a98a-7d16ad35d1ba" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.107200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2971b203-f109-457d-a98a-7d16ad35d1ba" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.107282] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2971b203-f109-457d-a98a-7d16ad35d1ba',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.118411] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.118568] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.118705] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.119011] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.119731] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.119978] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.120121] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.121126] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.121126] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.192766] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.493117] env[65660]: INFO networking_nsxv3.common.synchronization [None req-7be74043-ed44-49eb-9ef4-19d4ae2ef732 None None] Enqueued Resource ID: e9b1a63e-e4e8-4ba8-96dc-370819301899 with Priority: HIGHEST for action port [ 697.493117] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9b1a63e-e4e8-4ba8-96dc-370819301899 with Priority: HIGHEST for action port [ 697.493709] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9b1a63e-e4e8-4ba8-96dc-370819301899 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.493867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9b1a63e-e4e8-4ba8-96dc-370819301899" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.494018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9b1a63e-e4e8-4ba8-96dc-370819301899" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.494224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9b1a63e-e4e8-4ba8-96dc-370819301899" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.494298] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9b1a63e-e4e8-4ba8-96dc-370819301899',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.610034] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2971b203-f109-457d-a98a-7d16ad35d1ba [ 697.610034] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.610034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.610034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.610034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.610034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.610034] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2971b203-f109-457d-a98a-7d16ad35d1ba already deleted. [ 697.610034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2971b203-f109-457d-a98a-7d16ad35d1ba" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.623932] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.624399] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.624699] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.624969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.625229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.625479] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e not found, creating... [ 697.626022] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.626266] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.626456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.626791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.627026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.627487] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.628551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.628551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.628551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.628551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.628736] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e is going to be created. [ 697.655543] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.655757] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.655879] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.656187] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.656608] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.656608] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.695273] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.998945] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9b1a63e-e4e8-4ba8-96dc-370819301899 [ 697.998945] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.998945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.998945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.998945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.000024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.000784] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9b1a63e-e4e8-4ba8-96dc-370819301899 already deleted. [ 698.000784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9b1a63e-e4e8-4ba8-96dc-370819301899" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.197851] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.200845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.200845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.200845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.200845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.200845] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be updated. [ 698.230571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.230713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.230786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.231032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.231486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.242134] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 698.424830] env[65660]: INFO networking_nsxv3.common.synchronization [req-340e18c4-6b18-4839-87a2-03026d364737 req-57322d08-53ae-48cd-afcd-dff8583333f1 service nova] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_rules [ 698.425089] env[65660]: INFO networking_nsxv3.common.synchronization [req-340e18c4-6b18-4839-87a2-03026d364737 req-57322d08-53ae-48cd-afcd-dff8583333f1 service nova] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 698.425166] env[65660]: INFO networking_nsxv3.common.synchronization [req-340e18c4-6b18-4839-87a2-03026d364737 req-57322d08-53ae-48cd-afcd-dff8583333f1 service nova] Enqueued Resource ID: ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e with Priority: HIGHEST for action port [ 698.425673] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_rules [ 698.425794] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 698.426583] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e with Priority: HIGHEST for action port [ 698.428996] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.428996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.428996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.428996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.428996] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.432753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.432935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.433209] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.433336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.433419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.433639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.433750] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.935643] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.935879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.941282] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e with status ACTIVE [ 698.941572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.941741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.941932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.942201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.942317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.942618] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.942768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.942857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.943031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.943112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.943301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.943401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.943445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.943581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.943651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.943949] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e is going to be updated. [ 698.973457] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.973652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.973652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.973859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.973979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.974146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff9e0ef4-a1db-4f73-9ed3-9d40f8cd078e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.071708] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 in Status: SUCCESS [ 699.071708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.072175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.076527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.076527] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.076527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.076527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.076527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.076527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.076527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.076527] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.578671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.578671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.578671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.579304] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.579304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.579304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.579304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.579304] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.579304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.579488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.579488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.579559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.580035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.580035] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.085323] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 775da0ad-e96e-41a5-a2df-bf309e71cba6: rpc.has_security_group_logging(os_id): False [ 700.104236] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.104424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.104496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.107064] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.107064] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.110057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.110057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.110057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.110057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.110057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.110057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.110057] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 is going to be created. [ 700.189120] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.189283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.189355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.189566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.189747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.205943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 in Status: IN_PROGRESS for 2s [ 700.254841] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 4s [ 700.550171] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f19d92e5-8540-4169-a586-696fc8ea7390 None None] Enqueued Resource ID: 4066f4b1-ebff-4ff8-ad62-1d39702ee3f6 with Priority: HIGHEST for action port [ 700.550743] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4066f4b1-ebff-4ff8-ad62-1d39702ee3f6 with Priority: HIGHEST for action port [ 700.551301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4066f4b1-ebff-4ff8-ad62-1d39702ee3f6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.551301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4066f4b1-ebff-4ff8-ad62-1d39702ee3f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.551301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4066f4b1-ebff-4ff8-ad62-1d39702ee3f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.551936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4066f4b1-ebff-4ff8-ad62-1d39702ee3f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.552063] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4066f4b1-ebff-4ff8-ad62-1d39702ee3f6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.834155] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb023a73-6b06-49be-81cb-763d5875aa08 req-9fffee99-c9bc-4472-9353-caf6eac2d31f tempest-ServerPasswordTestJSON-1734341688 tempest-ServerPasswordTestJSON-1734341688-project-member] Enqueued Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_members [ 700.834155] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_members [ 700.834155] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.834155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.834155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.834155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.834155] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.834155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.834155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.834155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.835718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.835718] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.054196] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4066f4b1-ebff-4ff8-ad62-1d39702ee3f6 [ 701.054431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.054606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.054701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.055541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.055785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.055868] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4066f4b1-ebff-4ff8-ad62-1d39702ee3f6 already deleted. [ 701.055972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4066f4b1-ebff-4ff8-ad62-1d39702ee3f6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.337364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.337578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.337901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.340669] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.340669] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a30035af-7284-45ea-aa1f-a189cf5311fc already deleted. [ 701.340669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.389579] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.389706] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-232" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.389809] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-232" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.390124] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-232" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.390475] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.390568] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.390673] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.390882] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.391016] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.391506] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.392032] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.392032] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.392032] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.392175] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.392208] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.392759] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.413320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.413566] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.413749] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.414010] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-232" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.414407] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-a926e410-5d20-4b5b-924c-24e5ba636d12 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.414615] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.414765] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.415283] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.415479] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a926e410-5d20-4b5b-924c-24e5ba636d12',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.920953] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.920953] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.920953] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.920953] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.921385] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.921421] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port a926e410-5d20-4b5b-924c-24e5ba636d12 not found, creating... [ 701.921654] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.921823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.922030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.922325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.922462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.922731] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.922878] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.923064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.923275] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.923401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.923527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: a926e410-5d20-4b5b-924c-24e5ba636d12 is going to be created. [ 701.945503] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.945711] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.945825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.946103] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.946326] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.946539] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.218908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 in Status: SUCCESS [ 702.219065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.268869] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.268869] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.268869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.268869] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.705424] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb023a73-6b06-49be-81cb-763d5875aa08 req-2459e146-6306-4596-903e-e80051045ab3 service nova] Enqueued Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_rules [ 702.705424] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb023a73-6b06-49be-81cb-763d5875aa08 req-2459e146-6306-4596-903e-e80051045ab3 service nova] Enqueued Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_members [ 702.705424] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb023a73-6b06-49be-81cb-763d5875aa08 req-2459e146-6306-4596-903e-e80051045ab3 service nova] Enqueued Resource ID: a926e410-5d20-4b5b-924c-24e5ba636d12 with Priority: HIGHEST for action port [ 702.705424] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_rules [ 702.705424] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_members [ 702.705424] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a926e410-5d20-4b5b-924c-24e5ba636d12 with Priority: HIGHEST for action port [ 702.705424] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.705812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.705812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.705865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.705949] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.707726] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.707726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.707726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.708132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.708567] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.709440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.709440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.709440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.710537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.711113] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.713278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a926e410-5d20-4b5b-924c-24e5ba636d12 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.714541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.714806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.715427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.715819] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a926e410-5d20-4b5b-924c-24e5ba636d12',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.771675] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.219533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.219857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.219895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.220759] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a926e410-5d20-4b5b-924c-24e5ba636d12 with status ACTIVE [ 703.220957] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.221087] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.221146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.223693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.223693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.223693] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.223693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.223920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.224459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.224459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.224459] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.224621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.224621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.225587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.225587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.225587] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a926e410-5d20-4b5b-924c-24e5ba636d12 is going to be updated. [ 703.248801] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.248801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.248801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.248801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.248801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.248801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a926e410-5d20-4b5b-924c-24e5ba636d12" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.273106] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.488055] env[65660]: INFO networking_nsxv3.common.synchronization [req-6213befd-3632-48e5-b89d-0b510cee7e0a req-2a796ca8-a75c-4822-9a81-b126377a370a tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 703.489421] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 703.489421] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.489421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.489868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.490160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.491114] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.491253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.491396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.491652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.491874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.492111] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.727851] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.777139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.777139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.777358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.777411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.777618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.777618] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be updated. [ 703.807966] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.808468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.809779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.809779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.809779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.819635] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 703.987443] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.987443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.987443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.987443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.987443] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.987443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.987443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.987812] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.987812] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.987866] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.987975] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.988080] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.988179] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.988286] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.988408] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.988536] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.994149] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.994336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.994411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.994639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.994739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.994987] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.995112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.995176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.995330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.995473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.995579] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 704.009415] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.009605] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.009739] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.009942] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.010287] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-912add82-4c7b-42a1-8a72-93d308a49076 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.010451] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.010565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.010969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.011162] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912add82-4c7b-42a1-8a72-93d308a49076',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.024727] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.024919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.024968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.025160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.025294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.035509] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 704.222258] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b55b186b-4f58-4c24-bfc5-20a1b6003699 None None] Enqueued Resource ID: 9f25b61a-c5ab-40ba-b73f-d3f1943fc822 with Priority: HIGHEST for action port [ 704.222753] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f25b61a-c5ab-40ba-b73f-d3f1943fc822 with Priority: HIGHEST for action port [ 704.223115] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f25b61a-c5ab-40ba-b73f-d3f1943fc822 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.223250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f25b61a-c5ab-40ba-b73f-d3f1943fc822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.223309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f25b61a-c5ab-40ba-b73f-d3f1943fc822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.223573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f25b61a-c5ab-40ba-b73f-d3f1943fc822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.223658] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f25b61a-c5ab-40ba-b73f-d3f1943fc822',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.229782] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.229940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.230026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.230225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.230317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.230404] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a30035af-7284-45ea-aa1f-a189cf5311fc is going to be created. [ 704.255658] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.259020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.259020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.259020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.259020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.268210] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a30035af-7284-45ea-aa1f-a189cf5311fc in Status: UNINITIALIZED for 2s [ 704.513836] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.516686] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 912add82-4c7b-42a1-8a72-93d308a49076 not found, creating... [ 704.516686] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.516686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.517135] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.517919] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.518246] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.518560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.518782] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.519047] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 912add82-4c7b-42a1-8a72-93d308a49076 is going to be created. [ 704.539195] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.539195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.539195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.539520] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.539686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.539950] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.727634] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f25b61a-c5ab-40ba-b73f-d3f1943fc822 [ 704.727888] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.728040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.728112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.728321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.728412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.728505] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f25b61a-c5ab-40ba-b73f-d3f1943fc822 already deleted. [ 704.729610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f25b61a-c5ab-40ba-b73f-d3f1943fc822" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.327477] env[65660]: INFO networking_nsxv3.common.synchronization [req-6213befd-3632-48e5-b89d-0b510cee7e0a req-87438d5c-5d74-4b50-9b8d-5150a1fbec95 service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 705.328158] env[65660]: INFO networking_nsxv3.common.synchronization [req-6213befd-3632-48e5-b89d-0b510cee7e0a req-87438d5c-5d74-4b50-9b8d-5150a1fbec95 service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 705.328158] env[65660]: INFO networking_nsxv3.common.synchronization [req-6213befd-3632-48e5-b89d-0b510cee7e0a req-87438d5c-5d74-4b50-9b8d-5150a1fbec95 service nova] Enqueued Resource ID: 912add82-4c7b-42a1-8a72-93d308a49076 with Priority: HIGHEST for action port [ 705.329044] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 705.329231] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 705.329231] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912add82-4c7b-42a1-8a72-93d308a49076 with Priority: HIGHEST for action port [ 705.329502] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.330368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.330368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.330368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.330368] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.331152] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.331237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.331427] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-912add82-4c7b-42a1-8a72-93d308a49076 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.331507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.331569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.331756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.331860] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912add82-4c7b-42a1-8a72-93d308a49076',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.832946] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 705.833356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.833969] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.834259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.834844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.835187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.836694] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.836694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.836694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.840043] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.840043] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 912add82-4c7b-42a1-8a72-93d308a49076 with status ACTIVE [ 705.840043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.840043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.840043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.840043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.840771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.840771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.840771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.840771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.840771] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 912add82-4c7b-42a1-8a72-93d308a49076 is going to be updated. [ 705.864571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.864776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.864863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.865144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.865331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.865539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912add82-4c7b-42a1-8a72-93d308a49076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.045639] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 706.046978] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 706.047138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.047678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.047891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.048084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.048198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.048266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.048417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.048499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.048593] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.282863] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a30035af-7284-45ea-aa1f-a189cf5311fc in Status: SUCCESS [ 706.282863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.282863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.282863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.282863] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.282863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.282863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.283444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.283444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283444] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.328471] env[65660]: INFO networking_nsxv3.common.synchronization [req-130ebfe1-98b7-495c-9617-0f53b3fd0c10 req-ee00887e-9e67-43a2-8913-b278f62fff8a tempest-ServerActionsV293TestJSON-91498199 tempest-ServerActionsV293TestJSON-91498199-project-member] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_members [ 706.328752] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_members [ 706.329649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.331061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.331591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.331591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.331591] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.331929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.331929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.331929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.333227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.333227] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.342995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.344050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.344050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.344384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.344384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.344447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.344474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.344990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.344990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.344990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.344990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.345744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.345744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.345744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.345744] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.550804] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.664267] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5ec7e370-f124-4c7c-8b4b-0356cac68a59 None None] Enqueued Resource ID: 76564c58-1af8-4412-8281-d3ad43af7da0 with Priority: HIGHEST for action port [ 706.664856] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76564c58-1af8-4412-8281-d3ad43af7da0 with Priority: HIGHEST for action port [ 706.665288] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-76564c58-1af8-4412-8281-d3ad43af7da0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.665372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76564c58-1af8-4412-8281-d3ad43af7da0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.665455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76564c58-1af8-4412-8281-d3ad43af7da0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.665706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76564c58-1af8-4412-8281-d3ad43af7da0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.665798] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76564c58-1af8-4412-8281-d3ad43af7da0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.786551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.786671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.786743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.786960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.787153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.787435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.787435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.787582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.787582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.787675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.787786] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.787877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.787926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.788098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.788217] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.788302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.788353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.788489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.788550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.788632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.788719] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.835355] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.835579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.835651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.835930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.836052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.836295] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.836415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.836471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.836657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.836723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.836834] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a already deleted. [ 706.836926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.847858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf0f4a4-4808-4a1d-a832-54c26e813f60: rpc.has_security_group_logging(os_id): False [ 706.872964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.872964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.872964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.872964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.873620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.873620] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.873990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.874333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.874663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.874801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.874860] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be updated. [ 706.948471] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.948723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.948723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.949233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.949233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.967889] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 707.057287] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.131729] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.132687] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-854" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.132687] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-854" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.132687] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-854" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.132816] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.132929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.133033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.133265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.133402] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.133614] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.133720] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.134289] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.134289] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.134289] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.134289] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.134495] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.157072] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.157801] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.157801] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.157964] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-854" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.158608] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-82224622-3b4c-451c-b4a3-dcd8624109d7 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.158948] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.158948] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.159492] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.160188] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82224622-3b4c-451c-b4a3-dcd8624109d7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.172064] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76564c58-1af8-4412-8281-d3ad43af7da0 [ 707.172414] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.172572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.172641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.172910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.174889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.174889] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76564c58-1af8-4412-8281-d3ad43af7da0 already deleted. [ 707.175018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76564c58-1af8-4412-8281-d3ad43af7da0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.292732] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a30035af-7284-45ea-aa1f-a189cf5311fc: rpc.has_security_group_logging(os_id): False [ 707.316588] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.316736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.316806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.317043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.317140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.317348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.317446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.317510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.317729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.317825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.318028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.318115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.318171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.318313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.318388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.318570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.318660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.318716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.318851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.318921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.319044] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a30035af-7284-45ea-aa1f-a189cf5311fc is going to be created. [ 707.396254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.396254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.396254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.396254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.396254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.411592] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a30035af-7284-45ea-aa1f-a189cf5311fc in Status: IN_PROGRESS for 2s [ 707.561928] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.561928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.561928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.561928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.561928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.561928] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 707.611830] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.611830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.611830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.611830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.611830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.626099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 707.662575] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.662786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.662930] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.663299] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.663444] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.663590] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 82224622-3b4c-451c-b4a3-dcd8624109d7 not found, creating... [ 707.663851] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.664015] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.664122] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.664383] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.665718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.665718] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.665718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.665718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.665930] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.665930] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.666099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 82224622-3b4c-451c-b4a3-dcd8624109d7 is going to be created. [ 707.694146] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.694397] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.694516] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.694792] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.695133] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.695237] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.437364] env[65660]: INFO networking_nsxv3.common.synchronization [req-130ebfe1-98b7-495c-9617-0f53b3fd0c10 req-8433409a-7eaa-4628-a32c-2eba2c118fd2 service nova] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_rules [ 708.437364] env[65660]: INFO networking_nsxv3.common.synchronization [req-130ebfe1-98b7-495c-9617-0f53b3fd0c10 req-8433409a-7eaa-4628-a32c-2eba2c118fd2 service nova] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_members [ 708.437364] env[65660]: INFO networking_nsxv3.common.synchronization [req-130ebfe1-98b7-495c-9617-0f53b3fd0c10 req-8433409a-7eaa-4628-a32c-2eba2c118fd2 service nova] Enqueued Resource ID: 82224622-3b4c-451c-b4a3-dcd8624109d7 with Priority: HIGHEST for action port [ 708.438336] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_rules [ 708.438336] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_members [ 708.438336] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82224622-3b4c-451c-b4a3-dcd8624109d7 with Priority: HIGHEST for action port [ 708.438856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.439971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.439971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.439971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.439971] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.440289] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.440289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.440358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.440478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.440723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.441716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.442209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.442209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.442209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.445150] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.445150] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-82224622-3b4c-451c-b4a3-dcd8624109d7 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.445150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.445150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.445150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.445150] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82224622-3b4c-451c-b4a3-dcd8624109d7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.917633] env[65660]: INFO networking_nsxv3.common.synchronization [req-f6199b1b-0073-485e-8344-23b84125baf7 req-d14889a2-8406-4176-b295-ec73977c1ef9 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 708.918238] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 708.918539] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.918658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.918725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.918981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.923488] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.923488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.923488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.923488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.923488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.923488] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.945901] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82224622-3b4c-451c-b4a3-dcd8624109d7 with status ACTIVE [ 708.946576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.946576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.946576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.946736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.946736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.946921] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.947144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.947144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.947281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.947364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.947582] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.947700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.947756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.947901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.948349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.948349] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82224622-3b4c-451c-b4a3-dcd8624109d7 is going to be updated. [ 708.949314] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.950378] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.950496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.977472] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.978296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.978296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.978296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.978296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.978296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82224622-3b4c-451c-b4a3-dcd8624109d7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.985867] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 708.985867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.423545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a30035af-7284-45ea-aa1f-a189cf5311fc in Status: SUCCESS [ 709.424346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.425944] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.425944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.426099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.426288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.426469] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.426770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.426770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.426876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.427137] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 already deleted. [ 709.427294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.438476] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.438843] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-435" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.438843] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-435" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.439161] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-435" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.439414] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.439563] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.439717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.440024] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.440186] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.440413] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.440525] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.440649] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.440756] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.440880] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.441704] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.441948] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.451270] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.460741] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.460741] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.460741] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.460741] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-435" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.461552] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.461638] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.461710] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.462119] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.462772] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d896bf-7ef6-4421-9ebc-9a036f0f9c13',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.637541] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 709.637811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.638042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.638418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.638690] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.638817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.638956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.639045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.639153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.639303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.639411] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.953774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.955734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.955734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.955734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.955734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.955734] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a is going to be created. [ 709.966281] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.967045] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.967045] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.967723] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.969172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.969172] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 not found, creating... [ 709.969172] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.969172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.969403] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.970694] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.970694] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.970694] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.970931] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.971022] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.971338] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.971531] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.971728] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 is going to be created. [ 710.054307] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.054538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.054641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.054886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.055093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.056987] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.057244] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.057396] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.057666] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.057913] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.058239] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.069198] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a in Status: UNINITIALIZED for 2s [ 710.089529] env[65660]: INFO networking_nsxv3.common.synchronization [None req-61e47501-5988-4b2c-91d0-e8b6471ad54f None None] Enqueued Resource ID: 15666dc1-bfba-429b-a78e-31f9d9adb795 with Priority: HIGHEST for action port [ 710.090171] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15666dc1-bfba-429b-a78e-31f9d9adb795 with Priority: HIGHEST for action port [ 710.090526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-15666dc1-bfba-429b-a78e-31f9d9adb795 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.090651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15666dc1-bfba-429b-a78e-31f9d9adb795" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.090715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15666dc1-bfba-429b-a78e-31f9d9adb795" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.091016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15666dc1-bfba-429b-a78e-31f9d9adb795" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.091069] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15666dc1-bfba-429b-a78e-31f9d9adb795',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.142367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.142624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.142728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.143076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.143345] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.143532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.143634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.143898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.144060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.144212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.144420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.144540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.144599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.144770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.144960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.145092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.145163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.145391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.145530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.145663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.145811] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.593935] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15666dc1-bfba-429b-a78e-31f9d9adb795 [ 710.594179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.594179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.594179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.594404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.594500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.594696] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15666dc1-bfba-429b-a78e-31f9d9adb795 already deleted. [ 710.594696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15666dc1-bfba-429b-a78e-31f9d9adb795" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.648117] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 335a6866-6ca7-4c63-a411-59c67e151de0: rpc.has_security_group_logging(os_id): False [ 710.668291] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.669111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.669111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.669111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.669111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.669271] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.669799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.669799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.670036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.670036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.670805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.670805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.670805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.670805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.670805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.671588] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.672416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.672416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.672416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.672416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.672416] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 710.707568] env[65660]: INFO networking_nsxv3.common.synchronization [req-f6199b1b-0073-485e-8344-23b84125baf7 req-4bcf4fa9-8954-43ea-99bd-c5a5b0ce49b0 service nova] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 710.707568] env[65660]: INFO networking_nsxv3.common.synchronization [req-f6199b1b-0073-485e-8344-23b84125baf7 req-4bcf4fa9-8954-43ea-99bd-c5a5b0ce49b0 service nova] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 710.709016] env[65660]: INFO networking_nsxv3.common.synchronization [req-f6199b1b-0073-485e-8344-23b84125baf7 req-4bcf4fa9-8954-43ea-99bd-c5a5b0ce49b0 service nova] Enqueued Resource ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with Priority: HIGHEST for action port [ 710.709016] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 710.709016] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 710.709016] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with Priority: HIGHEST for action port [ 710.709016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.709016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.709630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.709630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.709630] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.711299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.711299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.711299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.711299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.711299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.711299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.711650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.711650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.711650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.711650] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.712518] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.712619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.712736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.712835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.713019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d896bf-7ef6-4421-9ebc-9a036f0f9c13',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.745212] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.745557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.745679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.745906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.746070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.762572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 711.214833] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.215012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.215213] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.216155] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with status ACTIVE [ 711.216342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.216451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.216510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.216705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.216794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.216963] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.217073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.217157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.217312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.217391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.217567] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.217664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.217726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.217862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.217933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.218024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 is going to be updated. [ 711.233016] env[65660]: INFO networking_nsxv3.common.synchronization [req-f5d9f02e-5748-46e0-9980-a07331dfd0d9 req-21cf3f63-ec2f-4467-a9e7-10c127de6f09 tempest-ServersTestJSON-1232390414 tempest-ServersTestJSON-1232390414-project-member] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_members [ 711.233455] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGHEST for action security_group_members [ 711.233773] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.233905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.233962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238010] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238226] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.238349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.238407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238792] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.241504] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.241620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.241688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.241914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.242129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.242296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.720518] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.740821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.740967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.741042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.741793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.741793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.741793] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.741793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.741793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.742061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.742061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.742061] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e is going to be updated. [ 711.775061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.775202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.775276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.775480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.775621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.786563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e in Status: IN_PROGRESS for 2s [ 712.084841] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a in Status: SUCCESS [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.086647] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.086647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.087259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.087259] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.223810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.223990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.224111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.224347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.224448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.224548] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be created. [ 712.258424] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.258661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.258736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.258972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.259148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.273572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: UNINITIALIZED for 2s [ 712.590293] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.779628] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 712.779983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.094279] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a: rpc.has_security_group_logging(os_id): False [ 713.114920] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.114920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.115062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.115315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.115315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.115534] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.115633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.115695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.115850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.115948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.116019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a is going to be created. [ 713.183510] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.183510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.183510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.184304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.184495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.198669] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a in Status: IN_PROGRESS for 2s [ 713.801021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e in Status: SUCCESS [ 713.801021] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e deletion is rescheduled due to dependency. [ 713.801021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.925387] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f5543d07-9032-4279-a5ea-5a278a9bfcd7 None None] Enqueued Resource ID: 5b0b0d4a-a989-4f74-97fd-0158e9d73ec9 with Priority: HIGHEST for action port [ 713.925387] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0b0d4a-a989-4f74-97fd-0158e9d73ec9 with Priority: HIGHEST for action port [ 713.925387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b0b0d4a-a989-4f74-97fd-0158e9d73ec9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.925635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b0b0d4a-a989-4f74-97fd-0158e9d73ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.925635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b0b0d4a-a989-4f74-97fd-0158e9d73ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.927255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b0b0d4a-a989-4f74-97fd-0158e9d73ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.927255] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b0b0d4a-a989-4f74-97fd-0158e9d73ec9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.256652] env[65660]: INFO networking_nsxv3.common.synchronization [req-cad72202-bece-461c-ad24-abdfc9e84470 req-6b30a54a-3ed7-48b7-87fd-3610e7222d31 tempest-MigrationsAdminTest-1938599151 tempest-MigrationsAdminTest-1938599151-project-member] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 714.256976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 714.257298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.257415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.257487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.257771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.257895] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.257997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.258130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.258398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.258398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.258398] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.283282] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 714.283511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.283682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.283911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.284131] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.284254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.284308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.284460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.284538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.284620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.284714] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.430303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b0b0d4a-a989-4f74-97fd-0158e9d73ec9 [ 714.430303] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.430303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.430303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.430303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.430303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.430303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b0b0d4a-a989-4f74-97fd-0158e9d73ec9 already deleted. [ 714.430303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b0b0d4a-a989-4f74-97fd-0158e9d73ec9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.761180] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.761180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.761369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.762410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.762537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.762762] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.762873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.762934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.763121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.763199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.763282] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 already deleted. [ 714.763395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.787601] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.805011] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.805369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.805566] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.806515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.806515] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.807083] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.807083] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.807910] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.808200] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.808548] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.808755] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.808991] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.809406] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.810166] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.810166] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.810166] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.836028] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.836028] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.836028] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.836028] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.836028] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.836028] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.836028] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.836028] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.836028] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.121212] env[65660]: INFO networking_nsxv3.common.synchronization [None req-90682d7b-c962-4af9-8b57-b8b968e7f038 None None] Enqueued Resource ID: 7e1944ff-c9ea-49c5-8914-e75804b36de5 with Priority: HIGHEST for action port [ 715.121841] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e1944ff-c9ea-49c5-8914-e75804b36de5 with Priority: HIGHEST for action port [ 715.122218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e1944ff-c9ea-49c5-8914-e75804b36de5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.122344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e1944ff-c9ea-49c5-8914-e75804b36de5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.122415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e1944ff-c9ea-49c5-8914-e75804b36de5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.122693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e1944ff-c9ea-49c5-8914-e75804b36de5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.122766] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e1944ff-c9ea-49c5-8914-e75804b36de5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.211016] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a in Status: SUCCESS [ 715.211232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.292040] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 575bfa27-1492-4754-bbae-fa15d2d40215: rpc.has_security_group_logging(os_id): False [ 715.313732] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.313903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.313961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.314332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.314469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.314719] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.314843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.314946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.315145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.315224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.315312] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be created. [ 715.340250] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.340436] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.340558] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.340901] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.341064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.341249] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 not found, creating... [ 715.341546] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.341717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.341853] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.342149] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.342330] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.342639] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.342816] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.343029] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.343289] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.343425] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.343547] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 is going to be created. [ 715.368583] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.368822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.369409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.369409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.369550] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.369754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.382681] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.383398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.383398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.383398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.383601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.401794] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 715.625887] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e1944ff-c9ea-49c5-8914-e75804b36de5 [ 715.625887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.625887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.625887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.626166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.626166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.626166] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e1944ff-c9ea-49c5-8914-e75804b36de5 already deleted. [ 715.626242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e1944ff-c9ea-49c5-8914-e75804b36de5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.138760] env[65660]: INFO networking_nsxv3.common.synchronization [req-cad72202-bece-461c-ad24-abdfc9e84470 req-d4a22d71-4976-4770-a637-b735d1e30627 service nova] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_rules [ 716.139033] env[65660]: INFO networking_nsxv3.common.synchronization [req-cad72202-bece-461c-ad24-abdfc9e84470 req-d4a22d71-4976-4770-a637-b735d1e30627 service nova] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 716.139066] env[65660]: INFO networking_nsxv3.common.synchronization [req-cad72202-bece-461c-ad24-abdfc9e84470 req-d4a22d71-4976-4770-a637-b735d1e30627 service nova] Enqueued Resource ID: 7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 with Priority: HIGHEST for action port [ 716.139301] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_rules [ 716.139463] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 716.139518] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 with Priority: HIGHEST for action port [ 716.140769] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.141620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.141620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.141620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.141620] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.142211] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.142262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.142328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.142902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.143121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.143223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.143280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.143429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.144268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.144268] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.145912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.146037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.146094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.146240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.146310] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.467190] env[65660]: INFO networking_nsxv3.common.synchronization [req-a9b2c96b-5b9c-492e-b5b5-f3ceaab3970c req-f739d970-0ce3-478b-850b-2f2789f4bb98 tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 716.467747] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 716.468198] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.468279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.468311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.468492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.468643] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.468737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.469195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.469195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.469195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.469195] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.650760] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 with status ACTIVE [ 716.651014] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.651383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.651383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.651508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.651602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.651787] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.651887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.652629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.652629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.652629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.652629] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.652629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.652629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.652883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.652883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.652883] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3 is going to be updated. [ 716.653967] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.661820] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.661935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.684638] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.684789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.684852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.685088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.685229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.685389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b22f3fd-3ddf-4f9a-a604-fc41778c5fa3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.972835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.972835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.972835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.972835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.972835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.972835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.972835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.972835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.973245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.973245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.973245] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be updated. [ 717.007804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.007804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.007804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.007804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.007804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.019350] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 717.162886] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.377213] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.377213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.377213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.377213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.377213] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.377213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.380136] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.380136] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.380136] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.380136] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.380136] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.380136] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.380136] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.380136] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.380136] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.380136] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.416588] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 717.416737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.417971] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.418255] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.418465] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.418710] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.419071] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-7059d024-fd6b-4131-9b23-95cc899ba836 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.419284] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.419429] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.419783] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.419969] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7059d024-fd6b-4131-9b23-95cc899ba836',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.474801] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2f40cdb3-525f-431f-846e-522cb773692b None None] Enqueued Resource ID: 0b373da4-ddd4-4287-a5f4-8ae43389858e with Priority: HIGHEST for action port [ 717.475352] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b373da4-ddd4-4287-a5f4-8ae43389858e with Priority: HIGHEST for action port [ 717.475829] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b373da4-ddd4-4287-a5f4-8ae43389858e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.475977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b373da4-ddd4-4287-a5f4-8ae43389858e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.476059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b373da4-ddd4-4287-a5f4-8ae43389858e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.476567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b373da4-ddd4-4287-a5f4-8ae43389858e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.476655] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b373da4-ddd4-4287-a5f4-8ae43389858e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.664549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.664755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.664819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.665032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.665107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.665205] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be created. [ 717.697803] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.698070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.698070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.698785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.698785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.708506] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: UNINITIALIZED for 2s [ 717.924655] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.924979] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.925189] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.925538] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.925695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.925907] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 7059d024-fd6b-4131-9b23-95cc899ba836 not found, creating... [ 717.926263] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.926490] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.926654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.926893] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.927087] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.927469] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.927588] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.927934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.927982] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.928278] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.928328] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 7059d024-fd6b-4131-9b23-95cc899ba836 is going to be created. [ 717.936958] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ab0b985a-0df4-4e68-a94c-cefc2f1a46ce None None] Enqueued Resource ID: a8c912c8-e173-4662-ba50-c1ba629aa802 with Priority: HIGHEST for action port [ 717.937570] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c912c8-e173-4662-ba50-c1ba629aa802 with Priority: HIGHEST for action port [ 717.937901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8c912c8-e173-4662-ba50-c1ba629aa802 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.937983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8c912c8-e173-4662-ba50-c1ba629aa802" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.938064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8c912c8-e173-4662-ba50-c1ba629aa802" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.938338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8c912c8-e173-4662-ba50-c1ba629aa802" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.938395] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8c912c8-e173-4662-ba50-c1ba629aa802',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.949714] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.950141] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.951592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.951649] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.951878] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.952157] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.979358] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b373da4-ddd4-4287-a5f4-8ae43389858e [ 717.979451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.979592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.979725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.979936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.980074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.980644] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b373da4-ddd4-4287-a5f4-8ae43389858e already deleted. [ 717.980644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b373da4-ddd4-4287-a5f4-8ae43389858e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.442225] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8c912c8-e173-4662-ba50-c1ba629aa802 [ 718.442525] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.442601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.442706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.442923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.443069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.443170] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8c912c8-e173-4662-ba50-c1ba629aa802 already deleted. [ 718.443262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8c912c8-e173-4662-ba50-c1ba629aa802" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.675131] env[65660]: INFO networking_nsxv3.common.synchronization [req-a9b2c96b-5b9c-492e-b5b5-f3ceaab3970c req-a6400229-ca8c-40dc-a806-3f6361714577 service nova] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_rules [ 718.675452] env[65660]: INFO networking_nsxv3.common.synchronization [req-a9b2c96b-5b9c-492e-b5b5-f3ceaab3970c req-a6400229-ca8c-40dc-a806-3f6361714577 service nova] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 718.675452] env[65660]: INFO networking_nsxv3.common.synchronization [req-a9b2c96b-5b9c-492e-b5b5-f3ceaab3970c req-a6400229-ca8c-40dc-a806-3f6361714577 service nova] Enqueued Resource ID: 7059d024-fd6b-4131-9b23-95cc899ba836 with Priority: HIGHEST for action port [ 718.675945] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_rules [ 718.676127] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 718.676233] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7059d024-fd6b-4131-9b23-95cc899ba836 with Priority: HIGHEST for action port [ 718.676503] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.676621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.676686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.676884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.679109] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.679109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.679109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.679109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7059d024-fd6b-4131-9b23-95cc899ba836 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.679109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.679109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.681328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.681328] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7059d024-fd6b-4131-9b23-95cc899ba836',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.029493] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 719.029744] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb deletion is rescheduled due to dependency. [ 719.029902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.030149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.030434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.030681] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.030836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.030926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.031149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.031258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.031410] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.183990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.183990] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7059d024-fd6b-4131-9b23-95cc899ba836 with status ACTIVE [ 719.183990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.183990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.183990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.183990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.184703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.184703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.184703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.184703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.184703] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7059d024-fd6b-4131-9b23-95cc899ba836 is going to be updated. [ 719.210435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.210646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.210738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.210917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.211133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.211300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7059d024-fd6b-4131-9b23-95cc899ba836" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.534685] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.725667] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 719.725667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.725667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.725667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.725667] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.725667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.725667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.726957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.727393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.728128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.728429] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.039828] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.223109] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b7e0c752-6c9c-4ccf-9067-afedbe63bc8e None None] Enqueued Resource ID: fe71218c-5a04-405e-9e8d-0ab683195cb8 with Priority: HIGHEST for action port [ 720.224861] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe71218c-5a04-405e-9e8d-0ab683195cb8 with Priority: HIGHEST for action port [ 720.225476] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe71218c-5a04-405e-9e8d-0ab683195cb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.225637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe71218c-5a04-405e-9e8d-0ab683195cb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.225795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe71218c-5a04-405e-9e8d-0ab683195cb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.226743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe71218c-5a04-405e-9e8d-0ab683195cb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.226876] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe71218c-5a04-405e-9e8d-0ab683195cb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.231899] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.232118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.232186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.232388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.233152] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.233431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.233524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.233705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.233853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.233961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.234349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.234349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.234349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.234493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.234561] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.234648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.234697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.234835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.234898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.234980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.235080] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.427019] env[65660]: INFO networking_nsxv3.common.synchronization [req-696eaa1c-c97f-4932-845b-9ac539e90487 req-cbe2e7bb-e61f-4d9f-8131-c0ab964dcf10 tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 720.428911] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 720.428911] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.428911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.428911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.428911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.429503] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.429589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.429771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.430746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.430746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.430746] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.546163] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.546451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.546451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.546702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.546828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.547262] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be updated. [ 720.587549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.587685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.588230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.588230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.588230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.599859] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 720.730274] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe71218c-5a04-405e-9e8d-0ab683195cb8 [ 720.730441] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.731193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.731193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.731193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.731193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.731193] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe71218c-5a04-405e-9e8d-0ab683195cb8 already deleted. [ 720.731193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe71218c-5a04-405e-9e8d-0ab683195cb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.737809] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5075ffdb-26d9-4c45-8f12-db06f5a52322: rpc.has_security_group_logging(os_id): False [ 720.762815] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.762953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.763035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.763260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.763368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.764157] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.764157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.764157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.764157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.764157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.764415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.764415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.764415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.764565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.764741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.764948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.764948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.765080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.768704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.768704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.768704] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be created. [ 720.849704] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.849704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.849704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.849835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.849958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.867908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: IN_PROGRESS for 2s [ 720.933434] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.991230] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.991471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.991618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.991821] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.992271] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.992799] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.992799] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.992913] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.993561] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.993561] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.993561] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.993561] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.993809] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.994060] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.994141] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.995229] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.017278] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.017575] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.017946] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.018222] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.018907] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.019067] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.019235] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.019794] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.020203] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.177146] env[65660]: INFO networking_nsxv3.common.synchronization [None req-82c1e777-12bf-42f7-a6b1-4fabb08a55df None None] Enqueued Resource ID: a219a0bd-b045-4b3a-a841-e4337d6284ea with Priority: HIGHEST for action port [ 721.177820] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a219a0bd-b045-4b3a-a841-e4337d6284ea with Priority: HIGHEST for action port [ 721.178364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a219a0bd-b045-4b3a-a841-e4337d6284ea taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.178513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a219a0bd-b045-4b3a-a841-e4337d6284ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.178584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a219a0bd-b045-4b3a-a841-e4337d6284ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.178856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a219a0bd-b045-4b3a-a841-e4337d6284ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.178943] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a219a0bd-b045-4b3a-a841-e4337d6284ea',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.437939] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.523150] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.523785] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.524139] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.524574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.526695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.526695] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 not found, creating... [ 721.526695] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.526695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.526695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.526695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.526695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.528225] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.530574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.530574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.530574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.530574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.530574] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 is going to be created. [ 721.553557] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.553918] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.554492] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.555118] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.555414] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.556433] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.686021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a219a0bd-b045-4b3a-a841-e4337d6284ea [ 721.686021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.686021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.686021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.686021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.686021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.686021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a219a0bd-b045-4b3a-a841-e4337d6284ea already deleted. [ 721.686021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a219a0bd-b045-4b3a-a841-e4337d6284ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.942968] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.943232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.943339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.943691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.943691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.943755] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 721.985289] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.985464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.985504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.985755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.985831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.997769] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 722.337636] env[65660]: INFO networking_nsxv3.common.synchronization [req-696eaa1c-c97f-4932-845b-9ac539e90487 req-4b63525e-ee50-4322-8ac8-05bcca9192d3 service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 722.337840] env[65660]: INFO networking_nsxv3.common.synchronization [req-696eaa1c-c97f-4932-845b-9ac539e90487 req-4b63525e-ee50-4322-8ac8-05bcca9192d3 service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 722.337971] env[65660]: INFO networking_nsxv3.common.synchronization [req-696eaa1c-c97f-4932-845b-9ac539e90487 req-4b63525e-ee50-4322-8ac8-05bcca9192d3 service nova] Enqueued Resource ID: 1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 with Priority: HIGHEST for action port [ 722.338533] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 722.338669] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 722.338767] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 with Priority: HIGHEST for action port [ 722.341598] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.341847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.341965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.342239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.342365] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.343756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.343865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.344913] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.345016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.345162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.345306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.345441] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.623456] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 722.623456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.623456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.623770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.623800] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.623931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.623976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.624326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.624326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.624544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.624544] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.643756] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b093f8c2-bd71-4f34-ac19-80802fc67df9 None None] Enqueued Resource ID: d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab with Priority: HIGHEST for action port [ 722.643756] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab with Priority: HIGHEST for action port [ 722.644027] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.644294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.644294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.644506] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.644623] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.847605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.847605] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.847605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 with status ACTIVE [ 722.847872] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.847872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.847872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.848291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.848291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.848291] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.848438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.848438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.848578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.848649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.849508] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.849508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.849508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.849508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.849508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.849508] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31 is going to be updated. [ 722.873637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.873772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.873879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.874229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.874591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.874687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d8bd467-fbb3-41cf-8acb-b6c3a4de2d31" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.887864] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 722.888747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.130708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.130708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.130708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.130708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.131126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.131126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.131126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.131126] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.131230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.131257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.131388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.131454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.131531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.131617] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.148257] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab [ 723.148499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.148624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.148690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.148899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.148983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.149095] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab already deleted. [ 723.149179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3b0f72f-1ec8-45a3-b3e3-9e41bc237aab" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.637927] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bb1aae9-5e28-4517-b1d1-0a8a052663cb: rpc.has_security_group_logging(os_id): False [ 723.659175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.659434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.659514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.659711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.659808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.660062] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.660176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.660239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.660399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.660479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.660658] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.660758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.660819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.661838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.661838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.661838] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.661838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.661838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.662134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.662134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.662134] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be updated. [ 723.734737] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.735117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.735117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.735332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.735489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.757967] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 724.013161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.013161] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.013161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.013161] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.517927] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.017991] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.522345] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.522518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.522559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.522917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.523066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.523228] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 725.578852] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.578994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.579081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.579464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.579631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.589475] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 725.684947] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c9d69be-4d1b-4c8c-89a0-76c231139048 req-808e98ae-15ea-4650-8818-857e62462885 tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 725.685605] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 725.685855] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.685995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.686148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.687249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.687249] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.687249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.687249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.687249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.687249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.687249] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.776173] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 725.778489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.140513] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.140952] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.141334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.141573] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.142016] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.142334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.142510] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.143492] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.143850] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.144110] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.148047] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.148047] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.148047] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.148047] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.148047] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.148047] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.171195] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.173384] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.173384] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.173384] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.173384] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-7bd73eb4-f859-432f-bcae-e93cd92a85ca taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.173384] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.173384] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.173384] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.173384] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd73eb4-f859-432f-bcae-e93cd92a85ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.190203] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.190681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.190794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.191187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.192530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.192530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.192530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.192530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.193887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.193887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.193887] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b already deleted. [ 726.193887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.677645] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.677645] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.677645] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.678162] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.678371] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.678562] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 7bd73eb4-f859-432f-bcae-e93cd92a85ca not found, creating... [ 726.678944] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.679202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.679265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.679513] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.679657] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.680069] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.680264] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.680384] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.680626] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.680820] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.680886] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 7bd73eb4-f859-432f-bcae-e93cd92a85ca is going to be created. [ 726.714747] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.715083] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.715248] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.715805] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.715934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.716270] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.479707] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c9d69be-4d1b-4c8c-89a0-76c231139048 req-da891ade-a9a0-4127-9765-8538c8762a75 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 727.480227] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c9d69be-4d1b-4c8c-89a0-76c231139048 req-da891ade-a9a0-4127-9765-8538c8762a75 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 727.480578] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c9d69be-4d1b-4c8c-89a0-76c231139048 req-da891ade-a9a0-4127-9765-8538c8762a75 service nova] Enqueued Resource ID: 7bd73eb4-f859-432f-bcae-e93cd92a85ca with Priority: HIGHEST for action port [ 727.481703] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 727.481818] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 727.481953] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd73eb4-f859-432f-bcae-e93cd92a85ca with Priority: HIGHEST for action port [ 727.482469] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.482789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.482960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.483375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.483512] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.485090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.485196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.485403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.485599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.486105] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.486335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.488202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.488411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.488508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.488903] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.489556] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd73eb4-f859-432f-bcae-e93cd92a85ca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.489678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.489718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.492036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.492036] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd73eb4-f859-432f-bcae-e93cd92a85ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.603218] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 727.603446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.603620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.603844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.604050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.604165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.604228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.604384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.604456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.604548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.604643] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.994398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.994507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.994699] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.995607] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bd73eb4-f859-432f-bcae-e93cd92a85ca with status ACTIVE [ 727.995795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.995910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.995976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.996192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.996972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.996972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.996972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.996972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.996972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.996972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.996972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.997313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.997313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.997313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.997388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.997414] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bd73eb4-f859-432f-bcae-e93cd92a85ca is going to be updated. [ 728.020481] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.020659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.020733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.021301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.021301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.021301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd73eb4-f859-432f-bcae-e93cd92a85ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.107610] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.107610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.107610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.107610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.107610] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.108112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.108112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.108112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.108216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.108336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.108573] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.108762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.108859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.109064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.109262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.109389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.109479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.109662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.109772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.109886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.110083] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.459788] env[65660]: INFO networking_nsxv3.common.synchronization [req-10921f81-722d-445f-bdc5-16ae909beb4b req-9f895526-4bcc-4a4b-ac9e-eb883c8bb306 tempest-InstanceActionsV221TestJSON-752680982 tempest-InstanceActionsV221TestJSON-752680982-project-member] Enqueued Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_members [ 728.460470] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_members [ 728.461099] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.461099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.461099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.461609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.461609] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.461609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.461791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.461889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.461980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.462112] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.501564] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.615037] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da44bcac-8dcd-43ae-b931-eee44940a29b: rpc.has_security_group_logging(os_id): False [ 728.638022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.638022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.638022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.638527] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.638527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.638527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.638527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.638527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.638678] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.638777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.638809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.638935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.639011] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.639604] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 728.720973] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.721127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.721198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.721402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.721556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.744166] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 728.920072] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-352 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.920250] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-352" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.920389] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-352" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.921721] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-352" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.923758] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.923861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.924078] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.924390] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.924602] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.924908] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.925043] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.925225] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.925382] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.925580] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.925689] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.925880] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.951386] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.951386] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.951386] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.951386] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-352" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.951386] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.951386] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.951386] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.951386] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.951386] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae84252-7e4c-4254-8be7-6ae4ad43ff05',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.964586] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.964791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.964850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.965204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.965290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.965592] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.965806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.965868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.966168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.966343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.966454] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dbcba73-4b06-4756-bd56-81b58777d093 already deleted. [ 728.966543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.005033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.005033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.005241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.005545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.005711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.005883] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be created. [ 729.037177] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.037368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.037408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.037659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.037822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.052450] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: UNINITIALIZED for 2s [ 729.453533] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.453779] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.453902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.454251] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.454427] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.454594] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 6ae84252-7e4c-4254-8be7-6ae4ad43ff05 not found, creating... [ 729.454906] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.455065] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.455200] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.455437] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.455591] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.456040] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.456241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.456378] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.456679] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.456786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.456914] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 6ae84252-7e4c-4254-8be7-6ae4ad43ff05 is going to be created. [ 729.481075] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.481327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.481441] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.481743] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.481987] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.482289] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.911482] env[65660]: INFO networking_nsxv3.common.synchronization [req-1623fee6-bb5e-4401-9dac-26a0527ec94c req-1d18f76e-fb91-4165-b0fb-6a0596f33497 tempest-ServerPasswordTestJSON-1734341688 tempest-ServerPasswordTestJSON-1734341688-project-member] Enqueued Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_members [ 729.912643] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGHEST for action security_group_members [ 729.912643] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.912643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.912643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.912807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.914512] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.914512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.914512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.914512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.914512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.914512] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.310337] env[65660]: INFO networking_nsxv3.common.synchronization [req-10921f81-722d-445f-bdc5-16ae909beb4b req-3a08215e-51eb-449c-a92f-778ff3de3e6d service nova] Enqueued Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_rules [ 730.310337] env[65660]: INFO networking_nsxv3.common.synchronization [req-10921f81-722d-445f-bdc5-16ae909beb4b req-3a08215e-51eb-449c-a92f-778ff3de3e6d service nova] Enqueued Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_members [ 730.310337] env[65660]: INFO networking_nsxv3.common.synchronization [req-10921f81-722d-445f-bdc5-16ae909beb4b req-3a08215e-51eb-449c-a92f-778ff3de3e6d service nova] Enqueued Resource ID: 6ae84252-7e4c-4254-8be7-6ae4ad43ff05 with Priority: HIGHEST for action port [ 730.311148] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_rules [ 730.311374] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_members [ 730.311447] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae84252-7e4c-4254-8be7-6ae4ad43ff05 with Priority: HIGHEST for action port [ 730.311705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.313100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.313100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.313100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.313100] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.314641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.314641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.314641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.314641] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.315716] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.315776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.316051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.316349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.316349] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae84252-7e4c-4254-8be7-6ae4ad43ff05',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.423301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.423301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.423301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.423301] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a30035af-7284-45ea-aa1f-a189cf5311fc is going to be updated. [ 730.453606] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.454065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.454065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.454152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.454249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.464943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a30035af-7284-45ea-aa1f-a189cf5311fc in Status: IN_PROGRESS for 2s [ 730.762577] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 730.762823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.818506] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.823845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.823845] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ae84252-7e4c-4254-8be7-6ae4ad43ff05 with status ACTIVE [ 730.823845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.823845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.823845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.823845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.824840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.824840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.824840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.824840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.824840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ae84252-7e4c-4254-8be7-6ae4ad43ff05 is going to be updated. [ 730.848926] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.849098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.849155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.849370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.849529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.849696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae84252-7e4c-4254-8be7-6ae4ad43ff05" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.063201] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 731.063455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.063597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.063804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.063996] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.064128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.064192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.064345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.064439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.064528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.064620] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.322044] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.574023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.574023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.574023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.574023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.574023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.574621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.574621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.574621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.574621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.574621] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.825651] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.825899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.825972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.826184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.826298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.826376] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dbcba73-4b06-4756-bd56-81b58777d093 is going to be created. [ 731.856556] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.856734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.856798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.857080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.857295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.869897] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dbcba73-4b06-4756-bd56-81b58777d093 in Status: UNINITIALIZED for 2s [ 732.076431] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e872372-e4f2-43b5-922d-ee045d8baf5b: rpc.has_security_group_logging(os_id): False [ 732.102365] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.102552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.102611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.102820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.102881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.103101] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.103366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.103366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.103554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.103635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.103825] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.103921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.103984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.104507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.104673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.104950] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.105043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.105154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.105346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.105422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.105507] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be created. [ 732.175847] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.176035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.176078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.176272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.176454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.193079] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 732.477831] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a30035af-7284-45ea-aa1f-a189cf5311fc in Status: SUCCESS [ 732.477831] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a30035af-7284-45ea-aa1f-a189cf5311fc deletion is rescheduled due to dependency. [ 732.477831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.443025] env[65660]: INFO networking_nsxv3.common.synchronization [req-4aa23d00-6865-426c-9457-4a354b9b3de0 req-e1236054-78e2-4d00-b3fa-972afe9791e6 tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 733.443025] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 733.443884] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.444600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.444600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.444752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.444946] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.445086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.445161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.445333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.445415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.445514] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.829778] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.829778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.829778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.829778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.829778] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.829778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.829778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.830301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.830548] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.830946] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.831162] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.831366] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.831643] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.831862] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.832071] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.832319] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.854519] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.854519] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.854519] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.854519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.854519] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-0f98acb3-23ce-436b-b5d0-939b84cdd68d taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.854889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.854889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.855192] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.855386] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f98acb3-23ce-436b-b5d0-939b84cdd68d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.884686] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dbcba73-4b06-4756-bd56-81b58777d093 in Status: SUCCESS [ 733.885198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.885707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.885948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.886781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.886781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.886781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.886781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.887062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.887062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.887266] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.952919] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.954048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.954048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.954048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.954048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.954276] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.954276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.954354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.954811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.954811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.954811] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 already deleted. [ 733.954811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.207152] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 734.207397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.358175] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.358482] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.358618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.358953] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.359157] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.359319] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 0f98acb3-23ce-436b-b5d0-939b84cdd68d not found, creating... [ 734.359592] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.359786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.359900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.360167] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.360306] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.360692] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.360852] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.361083] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.361223] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.361462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.361612] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 0f98acb3-23ce-436b-b5d0-939b84cdd68d is going to be created. [ 734.388180] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.388365] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.388508] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.388735] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.388955] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.389241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.391134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.391134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.391134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.391282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.391312] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.391485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.391485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.391608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.391717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.391960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.391960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.391960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.392095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.392217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.392360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.392447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.392504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.392642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.392738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.392801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.392877] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.549932] env[65660]: INFO networking_nsxv3.common.synchronization [req-6db90ebc-fcbb-4fd5-84d9-4451d3c61f09 req-e07e78df-18f3-4756-ab00-2eca16ebee26 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 734.550702] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 734.551331] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.551331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.551331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.551625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.551933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.552108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.552200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.552435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.552593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.552764] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.897033] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dbcba73-4b06-4756-bd56-81b58777d093: rpc.has_security_group_logging(os_id): False [ 734.924753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.924753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.924753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.925325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.925325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.925325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.926153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.926327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.928471] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.928668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.928710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.929718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.929939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.930073] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dbcba73-4b06-4756-bd56-81b58777d093 is going to be created. [ 735.018171] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.018360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.018401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.018606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.018780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.055719] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.056142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.056234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.056452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.056535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.056927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.057159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.057309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.057669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.057669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.058311] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb already deleted. [ 735.058311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.059028] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dbcba73-4b06-4756-bd56-81b58777d093 in Status: IN_PROGRESS for 2s [ 735.201425] env[65660]: INFO networking_nsxv3.common.synchronization [req-4aa23d00-6865-426c-9457-4a354b9b3de0 req-fc37d474-ff11-43c7-93c4-300e624a050e service nova] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_rules [ 735.201722] env[65660]: INFO networking_nsxv3.common.synchronization [req-4aa23d00-6865-426c-9457-4a354b9b3de0 req-fc37d474-ff11-43c7-93c4-300e624a050e service nova] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 735.201850] env[65660]: INFO networking_nsxv3.common.synchronization [req-4aa23d00-6865-426c-9457-4a354b9b3de0 req-fc37d474-ff11-43c7-93c4-300e624a050e service nova] Enqueued Resource ID: 0f98acb3-23ce-436b-b5d0-939b84cdd68d with Priority: HIGHEST for action port [ 735.202601] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_rules [ 735.202741] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 735.202911] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f98acb3-23ce-436b-b5d0-939b84cdd68d with Priority: HIGHEST for action port [ 735.204223] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.204368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.204456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.204733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.204840] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.205965] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.205965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.206154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.206234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.210016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.210261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.210336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.211428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.211428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.211428] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.211702] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f98acb3-23ce-436b-b5d0-939b84cdd68d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.211813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.211876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.212205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.212205] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f98acb3-23ce-436b-b5d0-939b84cdd68d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.541713] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.541941] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.542069] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.542415] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.542676] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.542836] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.542945] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.543316] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.543457] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.543667] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.543776] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.543877] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.543978] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.544101] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.544202] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.544325] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.567073] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.567317] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.567376] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.567552] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.567864] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-a0cc9108-2296-483a-9aa8-e2a3ff08a350 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.568041] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.568162] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.568477] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.568631] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0cc9108-2296-483a-9aa8-e2a3ff08a350',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.720916] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.720916] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.720916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.721186] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f98acb3-23ce-436b-b5d0-939b84cdd68d with status ACTIVE [ 735.721986] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.721986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.721986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.721986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.722245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.722491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.722738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.722945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.723269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.723431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.723795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.726126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.726126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.726126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.726126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.726126] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f98acb3-23ce-436b-b5d0-939b84cdd68d is going to be updated. [ 735.755270] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.755270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.755270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.755509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.755625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.755940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f98acb3-23ce-436b-b5d0-939b84cdd68d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.071672] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.071926] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.072183] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.072512] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.072681] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.072839] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port a0cc9108-2296-483a-9aa8-e2a3ff08a350 not found, creating... [ 736.073139] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.073355] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.073560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.073927] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.074182] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.074546] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.074730] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.074853] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.075080] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.075218] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.075352] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: a0cc9108-2296-483a-9aa8-e2a3ff08a350 is going to be created. [ 736.099365] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.099669] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.099865] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.100225] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.100546] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.100839] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.227998] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.732761] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.733168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.733168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.735682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.735682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.735682] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be created. [ 736.773705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.773900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.773963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.774201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.774399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.786847] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: UNINITIALIZED for 2s [ 736.957482] env[65660]: INFO networking_nsxv3.common.synchronization [req-6db90ebc-fcbb-4fd5-84d9-4451d3c61f09 req-3369319d-c43f-4c7a-8426-2c60c9f29aa8 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 736.957482] env[65660]: INFO networking_nsxv3.common.synchronization [req-6db90ebc-fcbb-4fd5-84d9-4451d3c61f09 req-3369319d-c43f-4c7a-8426-2c60c9f29aa8 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 736.957482] env[65660]: INFO networking_nsxv3.common.synchronization [req-6db90ebc-fcbb-4fd5-84d9-4451d3c61f09 req-3369319d-c43f-4c7a-8426-2c60c9f29aa8 service nova] Enqueued Resource ID: a0cc9108-2296-483a-9aa8-e2a3ff08a350 with Priority: HIGHEST for action port [ 736.958839] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 736.958839] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 736.958839] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0cc9108-2296-483a-9aa8-e2a3ff08a350 with Priority: HIGHEST for action port [ 736.960084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.960084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.960570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.960802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.960968] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.962267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.962423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.962538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.962813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.962960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.963190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.963190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.963604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.963604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.963604] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.964528] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0cc9108-2296-483a-9aa8-e2a3ff08a350 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.964670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.964670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.964831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.964928] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0cc9108-2296-483a-9aa8-e2a3ff08a350',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.074977] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dbcba73-4b06-4756-bd56-81b58777d093 in Status: SUCCESS [ 737.074977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.466701] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.468397] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.468613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.468781] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0cc9108-2296-483a-9aa8-e2a3ff08a350 with status ACTIVE [ 737.468951] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.469140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.469438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.469438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.469586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.469784] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.469864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.469864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.472624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.472774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.473087] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.473275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.473398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.473879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.473879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.473879] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0cc9108-2296-483a-9aa8-e2a3ff08a350 is going to be updated. [ 737.525978] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.525978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.525978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.526145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.526333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.526627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0cc9108-2296-483a-9aa8-e2a3ff08a350" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.647313] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-6627deee-4809-4d8c-95b0-ed5be0e501a0 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 737.647484] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 737.648109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.648284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.648409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.651426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.651426] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.651426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.651426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.651426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.651426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.651426] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.976742] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.085420] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-7ab45860-24d8-43ae-ab28-6b91bff324f8 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 738.086767] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 738.086767] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.086767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.152074] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.152074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.152074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.152512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.152512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.152601] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.152687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.152731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.152872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.152947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.153062] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 already deleted. [ 738.153137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.153309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.153462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.153604] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.153701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.153763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.153891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.153966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.154139] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.441628] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-803b92c5-de5c-45e9-8393-4b6b48315c80 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 738.442293] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 738.442673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.442775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.481185] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.481518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.481783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.482438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.482520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.482728] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be created. [ 738.512414] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.514825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.514825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.514825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.514825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.526038] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: UNINITIALIZED for 2s [ 738.656027] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.656242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.656291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.656500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.656749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.656826] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.656900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.657037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.657122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.657222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.657325] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 already deleted. [ 738.657407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.657581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.657731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.657869] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.657965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.658042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.658253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.658341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.658439] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.799465] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 738.799619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.799857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.800273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.800451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.800571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.800642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.800805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.800893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.800971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.801074] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.806616] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.806929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.807174] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.807592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.807958] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.808263] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.808442] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.808763] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.808901] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.809203] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.809586] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.809815] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.810155] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.810155] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.810395] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.810657] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.835048] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.835232] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.835379] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.835581] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.835892] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-efb29719-b6f2-4b1c-9a87-d9e81e506b36 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.836064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.836208] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.836541] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.836673] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efb29719-b6f2-4b1c-9a87-d9e81e506b36',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.161423] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.162062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.162062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.162234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.162348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.162668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.162844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.162960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.163258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.163430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.163524] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 already deleted. [ 739.163664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.304218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.304527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.304860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.305299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.305528] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.305734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.305837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.306136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.306278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.306428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.306692] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.306849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.306960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.307324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.307557] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.307720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.307834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.308071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.308373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.308373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.308428] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.340046] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.340046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.340046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.340046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.340543] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.340543] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port efb29719-b6f2-4b1c-9a87-d9e81e506b36 not found, creating... [ 739.340543] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.340730] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.340924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.341216] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.341396] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.341697] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.341887] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.342046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.342320] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.342487] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.342611] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: efb29719-b6f2-4b1c-9a87-d9e81e506b36 is going to be created. [ 739.385447] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.385812] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.386046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.386463] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.386799] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.387158] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.390827] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c80a401a-1ae5-4983-a81e-88125710e839 None None] Enqueued Resource ID: fc6824b7-465b-4651-9946-534bbb20c744 with Priority: HIGHEST for action port [ 739.391570] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6824b7-465b-4651-9946-534bbb20c744 with Priority: HIGHEST for action port [ 739.391810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc6824b7-465b-4651-9946-534bbb20c744 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.391942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc6824b7-465b-4651-9946-534bbb20c744" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.392052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc6824b7-465b-4651-9946-534bbb20c744" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.392539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc6824b7-465b-4651-9946-534bbb20c744" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.392539] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc6824b7-465b-4651-9946-534bbb20c744',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.811423] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80: rpc.has_security_group_logging(os_id): False [ 739.838954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.839204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.839204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.839439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.839532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.839749] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.839902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.839997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.840254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.840336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.840530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.840647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.840713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.840873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.840986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.841245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.841349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.841410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.841555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.841631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.841718] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be created. [ 739.895443] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc6824b7-465b-4651-9946-534bbb20c744 [ 739.895866] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.896189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.896367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.896737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.896915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.897114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc6824b7-465b-4651-9946-534bbb20c744 already deleted. [ 739.897267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc6824b7-465b-4651-9946-534bbb20c744" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.929622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.929819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.929879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.930085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.930477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.947805] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: IN_PROGRESS for 2s [ 740.168100] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-3b0883f2-d0ef-4f5c-8336-e5b0c35013fe service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 740.168380] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-3b0883f2-d0ef-4f5c-8336-e5b0c35013fe service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 740.168413] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-3b0883f2-d0ef-4f5c-8336-e5b0c35013fe service nova] Enqueued Resource ID: efb29719-b6f2-4b1c-9a87-d9e81e506b36 with Priority: HIGHEST for action port [ 740.169052] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 740.169534] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 740.169710] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb29719-b6f2-4b1c-9a87-d9e81e506b36 with Priority: HIGHEST for action port [ 740.170124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.170272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.170345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.170644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.170747] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.172388] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.172534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.172623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.172850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.173512] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.173648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.173716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.173966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.174168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.174168] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.175573] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-efb29719-b6f2-4b1c-9a87-d9e81e506b36 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.175573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.175573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.175573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.175573] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efb29719-b6f2-4b1c-9a87-d9e81e506b36',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.413579] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-398a01dd-f12d-4cc6-8852-185e388c572f tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 740.414357] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 740.415063] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.415177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.415177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.415500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.415708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.415842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.415943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.416167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.416280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.416404] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.536559] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 740.536825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.537012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.537504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.537573] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.537662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.537727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.537900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.538012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.538170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.538302] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.674067] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.674067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.678357] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efb29719-b6f2-4b1c-9a87-d9e81e506b36 with status ACTIVE [ 740.678357] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.678357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.678706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.678706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.678706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.678874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.679055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.679304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.679668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.679810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.679875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.680051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.680239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.680341] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efb29719-b6f2-4b1c-9a87-d9e81e506b36 is going to be updated. [ 740.681523] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.704961] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.705049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.705120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.705328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.705482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.705648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efb29719-b6f2-4b1c-9a87-d9e81e506b36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.755295] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.755619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.755775] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.756173] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.756543] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.756729] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.756883] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.757374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.757586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.757868] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.759092] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.759092] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.759092] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.759092] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.759092] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.759092] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.789144] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.789144] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.789144] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.789144] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.790937] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.790937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.790937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.790937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.790937] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d55cad46-80ca-404a-bf42-e9ca9be6e8b8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.922736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.923043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.923043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.924159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.924159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.924159] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.924159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.924159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.924159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.924467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.924467] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 already deleted. [ 740.924467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.007147] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.007354] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.009036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.009036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.009036] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.009036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.009036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.009036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.009036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.009036] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.009036] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.009488] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.009488] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.009488] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.009576] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.009736] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.038472] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.038641] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.038774] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.038961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.040515] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.040515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.040515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.040515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.040515] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.044292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.044458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.044564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.045460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.046429] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.046750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.047022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.047515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.047815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.048082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.048430] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.048791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.050029] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.050029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.050502] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.185490] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.294257] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.294378] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.294442] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.294729] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.294894] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.295018] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port d55cad46-80ca-404a-bf42-e9ca9be6e8b8 not found, creating... [ 741.295324] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.295472] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.295582] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.295804] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.295934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.296637] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.296637] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.296637] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.296803] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.296803] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.296943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: d55cad46-80ca-404a-bf42-e9ca9be6e8b8 is going to be created. [ 741.326232] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.326232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.326232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.326232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.326232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.326232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.553163] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.553904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.553904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.553904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.554056] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.554161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc not found, creating... [ 741.554444] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.554599] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.554723] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.554977] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.555940] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.555940] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.555940] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.555940] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.555940] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.555940] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.556182] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc is going to be created. [ 741.558035] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaef59ac-b94f-47d8-8852-ec864d2e9eeb: rpc.has_security_group_logging(os_id): False [ 741.563750] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d5c09123-4888-4720-8f20-431527cc0ff2 None None] Enqueued Resource ID: d3f2ad59-2e29-4572-b608-35c134aa43ff with Priority: HIGHEST for action port [ 741.563908] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f2ad59-2e29-4572-b608-35c134aa43ff with Priority: HIGHEST for action port [ 741.564289] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f2ad59-2e29-4572-b608-35c134aa43ff taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.564289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f2ad59-2e29-4572-b608-35c134aa43ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.564486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f2ad59-2e29-4572-b608-35c134aa43ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.564638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f2ad59-2e29-4572-b608-35c134aa43ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.564711] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f2ad59-2e29-4572-b608-35c134aa43ff',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.575494] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.576509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.576509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.576509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.576509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.576654] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.576740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.576826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.579065] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.579065] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.579065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.579065] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be created. [ 741.582099] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.582099] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.582099] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.582099] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.582371] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.582670] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.653084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.653355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.653355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.653573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.653762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.681144] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 741.688098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.688098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.688098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.688360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.688425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.688556] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be created. [ 741.732207] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.732207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.732207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.732207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.732207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.742364] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: UNINITIALIZED for 2s [ 741.961578] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 741.961791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.061856] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-93179335-eebe-447c-a4bf-6bb0e32ace71 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 742.062081] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-93179335-eebe-447c-a4bf-6bb0e32ace71 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 742.062265] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-93179335-eebe-447c-a4bf-6bb0e32ace71 service nova] Enqueued Resource ID: d55cad46-80ca-404a-bf42-e9ca9be6e8b8 with Priority: HIGHEST for action port [ 742.063135] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 742.063344] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 742.063456] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d55cad46-80ca-404a-bf42-e9ca9be6e8b8 with Priority: HIGHEST for action port [ 742.063948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.064241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.064322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.064619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.064704] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.065862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.065972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.066051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.066257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.066432] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.066527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.066643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.066763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.066857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.067361] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.068291] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.068400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.068467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.068619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.068697] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d55cad46-80ca-404a-bf42-e9ca9be6e8b8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.070139] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3f2ad59-2e29-4572-b608-35c134aa43ff [ 742.070622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.070622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.070622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.070622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.070858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.070858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3f2ad59-2e29-4572-b608-35c134aa43ff already deleted. [ 742.070858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f2ad59-2e29-4572-b608-35c134aa43ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.316349] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-9c074278-dc4d-466d-82a1-c79d2bbd8aeb service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 742.316667] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-9c074278-dc4d-466d-82a1-c79d2bbd8aeb service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 742.316667] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-9c074278-dc4d-466d-82a1-c79d2bbd8aeb service nova] Enqueued Resource ID: eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc with Priority: HIGHEST for action port [ 742.317299] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 742.317401] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 742.317851] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc with Priority: HIGHEST for action port [ 742.317851] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.317851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.318124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.318124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.318272] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.318370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.318445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.318842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.318951] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.570799] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.571068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.572438] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.573884] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d55cad46-80ca-404a-bf42-e9ca9be6e8b8 with status ACTIVE [ 742.574159] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.574330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.574405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.574643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.574816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.574925] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.575063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.575165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.576689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.576761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.577061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.577458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.577458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.577458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.577588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.577588] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d55cad46-80ca-404a-bf42-e9ca9be6e8b8 is going to be updated. [ 742.602334] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.602523] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.602571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.602753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.602892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.603060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d55cad46-80ca-404a-bf42-e9ca9be6e8b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.660485] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-445ebd37-53c6-4bf1-9ee7-bea7ff2b0467 tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 742.667071] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 742.667071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.667071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.821559] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc with status ACTIVE [ 742.821971] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.822401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.822401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.823175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.823175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.823175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.823572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.823572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.823572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.823572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.823846] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.823946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.824029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.824194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.824355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.824479] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc is going to be updated. [ 742.858961] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.859157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.859204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.859389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.859532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.859861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeb02ad0-c9c3-4ae5-875d-bbddacbc0afc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.080727] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.179541] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.179888] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.180102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.180551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.180961] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.182055] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.182055] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.182323] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.182514] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.182724] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.182838] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.182942] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.183060] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.183171] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.183317] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.183538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.211182] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.211360] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.211493] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.211658] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.212439] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-432fee2a-cfbd-4769-b411-5fc6b9799ad8 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.212681] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.212874] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.213262] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.213451] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432fee2a-cfbd-4769-b411-5fc6b9799ad8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.394106] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.394559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.394559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.394952] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.395268] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.395522] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.395672] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.395973] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.396401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.396401] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.396497] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.396988] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.396988] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.396988] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.396988] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.397149] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.418303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.418502] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.418664] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.418913] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-601" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.419253] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.419482] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.419577] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.419948] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.420144] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09578ee-b9c4-47c5-bb7a-bf6c215c8de6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.584051] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.584266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.584307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.584684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.584809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.584935] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be created. [ 743.610680] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.610923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.611099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.611409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.611640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.623659] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: UNINITIALIZED for 2s [ 743.695881] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 743.696132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.716812] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.717022] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.717228] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.717541] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.717756] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.717943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 432fee2a-cfbd-4769-b411-5fc6b9799ad8 not found, creating... [ 743.718709] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.718709] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.718709] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.718709] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.719025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.719327] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.719565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.719959] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.720095] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.720321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.720567] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 432fee2a-cfbd-4769-b411-5fc6b9799ad8 is going to be created. [ 743.744998] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.745257] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.745340] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.745659] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.746061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.746135] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.756179] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 743.756458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.756703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.757024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.757321] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.757500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.757591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.757831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.757948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.758085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.758236] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.759213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.759384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.759555] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.759661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.759728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.759870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.759948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.760056] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.923602] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.924070] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.924353] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.924929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.925240] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.925469] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 not found, creating... [ 743.925847] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.926042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.926188] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.926462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.926623] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.926988] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.927185] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.927317] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.927567] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.927710] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.927859] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 is going to be created. [ 743.952441] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.952732] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.952884] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.953232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.953500] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.953745] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.262252] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.262489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.262715] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.493780] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-cf520a23-8d03-4d98-bbd8-9730a7050e76 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 744.494058] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-cf520a23-8d03-4d98-bbd8-9730a7050e76 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 744.494203] env[65660]: INFO networking_nsxv3.common.synchronization [req-16fd9dfc-44c7-4228-a6cb-81bed7cc7908 req-cf520a23-8d03-4d98-bbd8-9730a7050e76 service nova] Enqueued Resource ID: 432fee2a-cfbd-4769-b411-5fc6b9799ad8 with Priority: HIGHEST for action port [ 744.494936] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 744.495080] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 744.495182] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432fee2a-cfbd-4769-b411-5fc6b9799ad8 with Priority: HIGHEST for action port [ 744.495539] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.495693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.495896] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.495993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.496233] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-432fee2a-cfbd-4769-b411-5fc6b9799ad8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.496358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.497058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.497058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.497058] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432fee2a-cfbd-4769-b411-5fc6b9799ad8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.700517] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-17807509-a26a-47d0-90c3-18a340530a41 service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 744.700517] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-17807509-a26a-47d0-90c3-18a340530a41 service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 744.700517] env[65660]: INFO networking_nsxv3.common.synchronization [req-e179bce5-725d-48c4-80fe-ed5b3b4a4710 req-17807509-a26a-47d0-90c3-18a340530a41 service nova] Enqueued Resource ID: c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 with Priority: HIGHEST for action port [ 744.701044] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 744.701188] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 744.701297] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 with Priority: HIGHEST for action port [ 744.701569] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.702659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.704445] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.704567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.704856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.704975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.705071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.705300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.705399] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09578ee-b9c4-47c5-bb7a-bf6c215c8de6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.765069] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.002807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 432fee2a-cfbd-4769-b411-5fc6b9799ad8 with status ACTIVE [ 745.003183] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.003338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.003410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.003627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.003719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.003956] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.004061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.004132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.004292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.004697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.006869] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.006869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.006869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.006869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.006869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.006869] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 432fee2a-cfbd-4769-b411-5fc6b9799ad8 is going to be updated. [ 745.032397] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.032628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.033339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.033339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.033339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.033339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432fee2a-cfbd-4769-b411-5fc6b9799ad8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.210154] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 with status ACTIVE [ 745.210443] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.210586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.210712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.210905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.211030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.211221] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.211342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.211408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.211593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.211674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.211867] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.211961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.212068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.212251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.212370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.212445] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c09578ee-b9c4-47c5-bb7a-bf6c215c8de6 is going to be updated. [ 745.238071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.238356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.238356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.238600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.238854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.239055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c09578ee-b9c4-47c5-bb7a-bf6c215c8de6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.267780] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.267989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.268050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.268261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.268368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.268480] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 745.299701] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.299869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.299869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.300240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.300619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.312263] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 745.360808] env[65660]: INFO networking_nsxv3.common.synchronization [req-d49930ec-5cc9-4fe2-9229-0e50fd26c812 req-e93628da-d2e4-4e6c-8129-972467032d4c tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 745.361423] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 745.361743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.361889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.361958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.362138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.362325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.362429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.362491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.362638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.362724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.362823] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.639157] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 745.639157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.639157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.639157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.640816] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.640816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.640974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.641720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.641832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.641928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.642043] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.643178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.643178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.643365] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.643492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.643552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.643703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.643780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.643881] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.761342] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-275 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.761660] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.761882] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.762934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.762934] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.762934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.762934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.762934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.763465] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.763564] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.764291] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.764291] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.764291] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.764291] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.764291] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.764291] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.787180] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.788180] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.788180] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.788180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-275" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.788180] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-a4a776a8-67c4-4cdf-8e85-540627d2f790 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.788511] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.788564] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.788906] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.789137] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a776a8-67c4-4cdf-8e85-540627d2f790',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.865250] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.146519] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.148290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.148631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.292341] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.292718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.292798] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.293092] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.293357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.293607] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port a4a776a8-67c4-4cdf-8e85-540627d2f790 not found, creating... [ 746.293909] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.294081] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.294292] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.294609] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.294851] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.299278] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.299511] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.299663] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.299953] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.300127] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.300325] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 is going to be created. [ 746.337482] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.337717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.337914] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.338424] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.338996] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.339180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.368416] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.650433] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.871251] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.872340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.872448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.873157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.873157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.873157] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 746.909457] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.909457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.909457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.909718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.909810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.926937] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 747.131015] env[65660]: INFO networking_nsxv3.common.synchronization [req-d49930ec-5cc9-4fe2-9229-0e50fd26c812 req-2fb7b8af-615b-40c9-9e60-191e96dc6848 service nova] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 747.131211] env[65660]: INFO networking_nsxv3.common.synchronization [req-d49930ec-5cc9-4fe2-9229-0e50fd26c812 req-2fb7b8af-615b-40c9-9e60-191e96dc6848 service nova] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 747.132347] env[65660]: INFO networking_nsxv3.common.synchronization [req-d49930ec-5cc9-4fe2-9229-0e50fd26c812 req-2fb7b8af-615b-40c9-9e60-191e96dc6848 service nova] Enqueued Resource ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 with Priority: HIGHEST for action port [ 747.132347] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 747.132347] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 747.132638] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 with Priority: HIGHEST for action port [ 747.132987] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.133122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.133385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.133511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.133543] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.134458] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.134665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.134746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a776a8-67c4-4cdf-8e85-540627d2f790 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.134831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.134917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.135115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.135190] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a776a8-67c4-4cdf-8e85-540627d2f790',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.153075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.153521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.153719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.154078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.154273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.154457] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 747.191440] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.191440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.191440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.191440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.191440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.202276] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 747.327814] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 747.329470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.329470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.329470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.329470] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.329470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.329470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.329791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.329791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.329791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.330496] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.331377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.331479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.331667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.331892] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.332026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.332090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.332338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.332445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.332603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.332671] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.333665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.333848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.334085] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.334288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.334345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.334521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.334617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.335185] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.636805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.636953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.637166] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4a776a8-67c4-4cdf-8e85-540627d2f790 with status ACTIVE [ 747.637370] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.637484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.637571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.638013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.638013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.638134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.638258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.638350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.638575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.638689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.638909] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.639024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.639063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.639236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.639269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.639339] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 is going to be updated. [ 747.695795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.695795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.696241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.696241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.696241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.696787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.838622] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5: rpc.has_security_group_logging(os_id): False [ 747.841087] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.872088] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.872204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.872310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.872818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.872818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.873112] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.873335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.873453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.873773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.874025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.875033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.875153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.875209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.875423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.875557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.876089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.876203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.876260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.876462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.876609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.876768] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be created. [ 748.020026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.020026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.020026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.020026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.020026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.037185] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 748.319743] env[65660]: INFO networking_nsxv3.common.synchronization [req-83362853-f22b-404b-bc1b-ee36b4c1e10f req-cb5d32ba-37a3-45ac-bfda-294d84a64dd9 tempest-ServerTagsTestJSON-184075780 tempest-ServerTagsTestJSON-184075780-project-member] Enqueued Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_members [ 748.320872] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_members [ 748.321804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.321804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.321804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.322841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.322841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.322841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.322841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.322841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.323028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.323454] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.346182] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.767283] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.767689] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.767757] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.768354] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.768725] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.769329] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.769329] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.769643] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.769815] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.770035] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.770154] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.774026] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.774026] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.774026] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.774026] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.774026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.794899] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.795117] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.795249] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.795364] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.795674] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-f0c41936-8441-4a21-a98b-be7d5d0eb641 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.795835] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.795941] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.796324] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.796501] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0c41936-8441-4a21-a98b-be7d5d0eb641',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.826164] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.826397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.826397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.826586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.826805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.826868] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.826996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.827072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.827227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.827366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.827439] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6705170-58ac-456b-99c6-9d36829cfeca already deleted. [ 748.827490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.847390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.847546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.847611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.847809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.847916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.847984] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 748.889917] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.890161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.890418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.890805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.890974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.902976] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 748.938351] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 748.938818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.939056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.939322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.939630] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.939797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.939899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.940213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.940364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.940527] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.217972] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 749.218289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.218543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.218849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.219297] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.219544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.219690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.219997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.220192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.220361] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.299486] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.299889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.300056] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.300498] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.300665] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.300816] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port f0c41936-8441-4a21-a98b-be7d5d0eb641 not found, creating... [ 749.301167] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.301343] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.301457] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.301693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.301825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.302167] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.302397] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.302572] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.302888] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.303121] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.303361] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: f0c41936-8441-4a21-a98b-be7d5d0eb641 is going to be created. [ 749.348850] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.349201] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.349343] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.350190] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.350190] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.350190] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.443679] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.723415] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.772573] env[65660]: INFO networking_nsxv3.common.synchronization [req-bcc42aca-412b-49ab-a32f-d69e121589f8 req-ea424359-57b1-49c5-b3c6-b1f4da98ee7c tempest-ServersTestManualDisk-1744811056 tempest-ServersTestManualDisk-1744811056-project-member] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_members [ 749.773361] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGHEST for action security_group_members [ 749.773806] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.773937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.773981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.774330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.774580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.774727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.774947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.775137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.775137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.775267] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.946706] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.052564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 750.052564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.052564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.052564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.052564] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.163212] env[65660]: INFO networking_nsxv3.common.synchronization [req-83362853-f22b-404b-bc1b-ee36b4c1e10f req-a8b1565e-79a6-4f96-806c-02c72d2a6a4c service nova] Enqueued Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_rules [ 750.163451] env[65660]: INFO networking_nsxv3.common.synchronization [req-83362853-f22b-404b-bc1b-ee36b4c1e10f req-a8b1565e-79a6-4f96-806c-02c72d2a6a4c service nova] Enqueued Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_members [ 750.163627] env[65660]: INFO networking_nsxv3.common.synchronization [req-83362853-f22b-404b-bc1b-ee36b4c1e10f req-a8b1565e-79a6-4f96-806c-02c72d2a6a4c service nova] Enqueued Resource ID: f0c41936-8441-4a21-a98b-be7d5d0eb641 with Priority: HIGHEST for action port [ 750.169340] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_rules [ 750.169340] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_members [ 750.169340] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c41936-8441-4a21-a98b-be7d5d0eb641 with Priority: HIGHEST for action port [ 750.169340] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.169340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.169340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.169340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.169340] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.170081] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.170213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.170276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.170461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.170612] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.170705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.170766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.170907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.170992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.173078] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.174106] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0c41936-8441-4a21-a98b-be7d5d0eb641 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.174219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.174290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.174476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.174619] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0c41936-8441-4a21-a98b-be7d5d0eb641',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.225733] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.278074] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.278309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.278309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.278542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.279324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.279324] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.279324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.279324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.279658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.279658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.279658] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 is going to be updated. [ 750.316341] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.316341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.316341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.316341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.316341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.334630] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 in Status: IN_PROGRESS for 2s [ 750.451495] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.451813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.451905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.452319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.452417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.452564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 750.470590] env[65660]: INFO networking_nsxv3.common.synchronization [req-84495105-9bb1-48f6-84c1-0ede537a118c req-0a7e470e-aa60-450b-a919-7981a0343ebd tempest-InstanceActionsV221TestJSON-752680982 tempest-InstanceActionsV221TestJSON-752680982-project-member] Enqueued Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_members [ 750.471578] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGHEST for action security_group_members [ 750.471945] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.472095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.472165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.472414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.472570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.472701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.472764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.472937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.473037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.473133] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.484749] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.484970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.485054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.485270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.485411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.498084] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 750.554390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.554578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.676257] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.682093] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.682093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.682093] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0c41936-8441-4a21-a98b-be7d5d0eb641 with status ACTIVE [ 750.682093] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.682093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.682093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.682671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.682671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.682982] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.682982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.683288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.683517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.683609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.683812] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.683910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.683972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.684153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.684230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.684317] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0c41936-8441-4a21-a98b-be7d5d0eb641 is going to be updated. [ 750.716883] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.717071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.717180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.717402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.717587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.717860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0c41936-8441-4a21-a98b-be7d5d0eb641" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.729809] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.730083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.730286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.730401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.730561] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 750.792094] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.792598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.792598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.792763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.792918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.804918] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 750.915151] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 750.915437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.915708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.916035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.916213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.916377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.916486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.916681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.916785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.916916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.917033] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.976585] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.976789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.976881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.977177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.977288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.977547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.977654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.977718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.977934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.978045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.978148] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dbcba73-4b06-4756-bd56-81b58777d093 is going to be updated. [ 751.019852] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.019852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.019852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.020348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.020417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.031834] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dbcba73-4b06-4756-bd56-81b58777d093 in Status: IN_PROGRESS for 2s [ 751.188909] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.314462] env[65660]: INFO networking_nsxv3.common.synchronization [req-6afafdef-ffde-4173-9909-90d2158469f9 req-03963b2d-204c-4a1e-826b-11e48544191f tempest-ServersTestBootFromVolume-443678150 tempest-ServersTestBootFromVolume-443678150-project-member] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_members [ 751.316440] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGHEST for action security_group_members [ 751.317722] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.317869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.317938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.318183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.318349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.318447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.318507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.318653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.318736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.318923] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.420060] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.420060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.420060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.420060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.420432] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.420485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.420544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.420727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.420819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.420910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.421080] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.421197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.421265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.421406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.421559] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.421705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.421832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.422089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.422174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.422264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.422397] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.691233] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.691581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.691976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.692135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.693019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.693019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6705170-58ac-456b-99c6-9d36829cfeca is going to be created. [ 751.737534] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.737742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.737813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.738085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.738334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.754243] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6705170-58ac-456b-99c6-9d36829cfeca in Status: UNINITIALIZED for 2s [ 751.821143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.821494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.821494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.821708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.821708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.821922] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.822073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.822151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.822338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.822431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.822536] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 is going to be updated. [ 751.869109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.869109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.869109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.869109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.869465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.885161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2dca75-cd86-462e-b41c-7286490b3384 in Status: IN_PROGRESS for 2s [ 751.927732] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5: rpc.has_security_group_logging(os_id): False [ 751.963764] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.963994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.964134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.964502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.964684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.965075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.965270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.965373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.965657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.965789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.966582] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.966793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.966871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.967107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.967211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.967495] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.967606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.967679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.967923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.967990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.968067] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 752.057668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.057668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.057668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.057668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.057668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.084851] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 752.348616] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 in Status: SUCCESS [ 752.348788] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 deletion is rescheduled due to dependency. [ 752.348907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.514390] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 752.514598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.514772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.514994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.515342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.515655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.516984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.516984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.516984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.517155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.517203] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.829980] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.829980] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.829980] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.829980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.829980] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.831671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.832036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.832599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.833717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.833717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.833717] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.020121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.020327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.020418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.020623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.020927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.020927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.021114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.021145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.021223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.021315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.021482] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.021795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.021795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.021795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.022061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.022061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.022061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.022265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.022265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.022371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.022863] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.048894] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dbcba73-4b06-4756-bd56-81b58777d093 in Status: SUCCESS [ 753.049118] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dbcba73-4b06-4756-bd56-81b58777d093 deletion is rescheduled due to dependency. [ 753.049241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.338087] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6: rpc.has_security_group_logging(os_id): False [ 753.365283] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.365283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.365283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.365592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.365798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.366310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.366684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.367275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.367392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.367679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.368149] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.368409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.368409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.368666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.368894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.369262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.369428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.369529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.369811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.370019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.370164] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be created. [ 753.448205] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.448205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.448205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.448205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.448205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.468237] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 753.527308] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 753.569393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.570410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.570410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.570410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.570410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.570410] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.570681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.570681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.570773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.570871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.571090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.574032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.574032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.574658] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 753.656720] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.657716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.657716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.657716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.657874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.675372] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 753.774064] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6705170-58ac-456b-99c6-9d36829cfeca in Status: SUCCESS [ 753.774293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.774491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.774783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.774998] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.775126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.775185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.775350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.775435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.775616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.775616] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.897331] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2dca75-cd86-462e-b41c-7286490b3384 in Status: SUCCESS [ 753.897623] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 deletion is rescheduled due to dependency. [ 753.897686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.106219] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 754.106219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.106219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.106219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.106219] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.282175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.282175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.282175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.282175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.282175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.282821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.282821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.282821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.282821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.283962] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.609075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.609075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.609075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.609545] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.789287] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6705170-58ac-456b-99c6-9d36829cfeca: rpc.has_security_group_logging(os_id): False [ 754.811025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.811025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.811025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.811025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.811636] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.811636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.811636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.811636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.811892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.812103] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6705170-58ac-456b-99c6-9d36829cfeca is going to be created. [ 754.885571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.886044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.886044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.890781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.890781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.904329] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6705170-58ac-456b-99c6-9d36829cfeca in Status: IN_PROGRESS for 2s [ 755.113324] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.113324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.113324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.113708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.113708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.113922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.113966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.114145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.114242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.114384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.114572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.114685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.114802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.114996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.115153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.115280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.115357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.115580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.115681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.115795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.115941] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.490198] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 755.490198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.490198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.490198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.490198] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.618517] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5: rpc.has_security_group_logging(os_id): False [ 755.640466] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.640623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.640738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.640895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.640983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.641178] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.641277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.641338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.641528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.641576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.641740] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.641833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.641891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.642038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.642113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.642882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.642882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.642882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.642882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.642882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.642882] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 755.684845] env[65660]: INFO networking_nsxv3.common.synchronization [req-a90de600-cf77-4f12-8d97-2400301aeea7 req-ab5711fb-8ade-4bbf-8f9a-398fb6b38d8f tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 755.685155] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 755.685877] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.685877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.685877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.686068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.686442] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.686442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.686442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.686590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.686988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.686988] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.697240] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 755.697240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.712280] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.712280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.712280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.712483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.712718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.736952] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 755.991729] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.992112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.992112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.992250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.995462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.995462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.995462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.995462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.995462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.995462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.995462] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.188953] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.255107] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.255107] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.255107] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.255107] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.256023] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.256023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.256023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.256229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.256339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.256656] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.256656] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.256902] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.256902] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.256902] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.257119] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.257119] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.287031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.287031] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.287031] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.287031] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.287401] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-e8b20bba-7acf-44d3-9668-e19a0ace0672 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.287401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.287577] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.287862] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.288560] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b20bba-7acf-44d3-9668-e19a0ace0672',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.502021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.502021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.502021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.502021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.502021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.502809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.502809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.502809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.502809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.502809] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.692397] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.792192] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.792406] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.793063] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.793533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.794137] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.794137] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port e8b20bba-7acf-44d3-9668-e19a0ace0672 not found, creating... [ 756.794562] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.794800] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.794927] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.795178] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.795310] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.795589] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.795740] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.795849] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.796073] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.796223] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.796355] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: e8b20bba-7acf-44d3-9668-e19a0ace0672 is going to be created. [ 756.816575] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.816697] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.816783] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.817156] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.817280] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.817569] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.932391] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6705170-58ac-456b-99c6-9d36829cfeca in Status: SUCCESS [ 756.932736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.004956] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6: rpc.has_security_group_logging(os_id): False [ 757.026927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.027114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.027168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.027440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.027541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.027795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.027903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.027997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.028221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.028291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.028541] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.028693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.028795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.028991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.029306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.029661] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.029823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.029922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.030163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.030276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.030407] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 757.105450] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.105607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.105651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.105874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.106036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.119947] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 757.194998] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.195183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.195269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.195612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.195879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.196347] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be updated. [ 757.261138] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.261138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.261138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.261305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.261847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.280689] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: IN_PROGRESS for 2s [ 757.661762] env[65660]: INFO networking_nsxv3.common.synchronization [req-a90de600-cf77-4f12-8d97-2400301aeea7 req-6af05546-7b07-4b27-a6f7-e0f804bb2dc6 service nova] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_rules [ 757.661994] env[65660]: INFO networking_nsxv3.common.synchronization [req-a90de600-cf77-4f12-8d97-2400301aeea7 req-6af05546-7b07-4b27-a6f7-e0f804bb2dc6 service nova] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 757.662180] env[65660]: INFO networking_nsxv3.common.synchronization [req-a90de600-cf77-4f12-8d97-2400301aeea7 req-6af05546-7b07-4b27-a6f7-e0f804bb2dc6 service nova] Enqueued Resource ID: e8b20bba-7acf-44d3-9668-e19a0ace0672 with Priority: HIGHEST for action port [ 757.663206] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_rules [ 757.663206] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 757.663206] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8b20bba-7acf-44d3-9668-e19a0ace0672 with Priority: HIGHEST for action port [ 757.663402] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.663526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.663601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.663830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.663908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.664912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.665027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.665243] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8b20bba-7acf-44d3-9668-e19a0ace0672 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.665347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.665412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.665633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.665671] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b20bba-7acf-44d3-9668-e19a0ace0672',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.763816] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 757.764103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.061508] env[65660]: INFO networking_nsxv3.common.synchronization [req-088fe68f-bc7c-42e5-a82f-69bb44e83fdf req-5577e4c8-cc2c-4cd9-980a-0ab62d1f7170 tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 758.064584] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 758.066851] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.067081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.067193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.067456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.067679] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.067828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.067911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.068250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.068371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.068543] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.168097] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.168457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.168689] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8b20bba-7acf-44d3-9668-e19a0ace0672 with status ACTIVE [ 758.169580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.169580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.169580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.169580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.169580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.172139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.172139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.172139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.172139] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8b20bba-7acf-44d3-9668-e19a0ace0672 is going to be updated. [ 758.209132] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.209415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.209415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.209575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.209725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.209915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8b20bba-7acf-44d3-9668-e19a0ace0672" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.572673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.572872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.572966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.573262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.573392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.573645] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.573785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.574266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.574266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.574266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.574414] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 758.610871] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.611213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.611269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.611586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.611959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.641029] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 758.683301] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 758.683301] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 758.683820] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 758.684046] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 758.684563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.684647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.684876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.685177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.685418] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.685574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.685671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.685926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.686077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.686243] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.687535] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.687682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.687682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.687929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.688080] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.688195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.688271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.688546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.688650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.688880] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.747739] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_rules [ 758.748914] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [req-dd0ba77a-7d24-4d98-a3af-71ad8443b096 req-28c6b70c-91ec-4d92-b659-1329cb253c89 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 with Priority: HIGHEST for action port [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_rules [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 with Priority: HIGHEST for action port [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 758.751912] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 758.752704] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.752704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.752704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.752832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.752930] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.755230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.755407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.755504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.755806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.755930] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.758511] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a776a8-67c4-4cdf-8e85-540627d2f790 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.758759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.759455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.759894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.760665] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a776a8-67c4-4cdf-8e85-540627d2f790',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.762297] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.762509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.763115] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.763115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.836151] env[65660]: INFO networking_nsxv3.common.synchronization [req-b8601954-6048-4ee8-bf6e-2cbe72f452fd req-e31f46c8-4fac-416c-b49d-b88d4d4b9dbc tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 758.836943] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 758.838301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.838301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.838301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.838301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.838301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.838749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.838749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.838852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.838903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.839158] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.143528] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 759.144580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.191566] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.193272] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.265246] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.265401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.265582] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4a776a8-67c4-4cdf-8e85-540627d2f790 with status ACTIVE [ 759.265707] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.265847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.265890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.266101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.266194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.266363] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.266467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.266514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.266726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.266783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.266958] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.267060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.267124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.267261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.267460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.267460] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 is going to be updated. [ 759.268565] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.268678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.293772] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 759.293772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.293772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.293772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.293772] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.293772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.293772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.294174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.294174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.294299] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.304588] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.304824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.304943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.305303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.305547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.305820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.342674] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.696258] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.697281] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.798027] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.846196] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.203293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.203740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.203740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.206763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.206958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.210257] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be created. [ 760.210257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.210257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.210257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.210257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.210257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.210257] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 760.247480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.247480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.247480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.247480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.247480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.254617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.254992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.255219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.255553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.257022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.260916] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: UNINITIALIZED for 2s [ 760.271754] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 760.301646] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.348674] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.349702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.349702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.349702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.349702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.350031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 760.410744] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.411224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.411464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.411912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.412247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.429191] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 760.623897] env[65660]: INFO networking_nsxv3.common.synchronization [req-f2e077ca-e2f2-44f4-acbd-4889ed4f4486 req-d45aa9c3-01e9-490b-9339-d6d76553780b tempest-FloatingIPsAssociationNegativeTestJSON-856864171 tempest-FloatingIPsAssociationNegativeTestJSON-856864171-project-member] Enqueued Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_members [ 760.624718] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 with Priority: HIGHEST for action security_group_members [ 760.625172] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-775da0ad-e96e-41a5-a2df-bf309e71cba6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.625327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.625369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.625608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.625785] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.625885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.626019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.626246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.626850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.626850] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('775da0ad-e96e-41a5-a2df-bf309e71cba6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.651740] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 760.652035] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 760.652196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.805906] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.806205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.806311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.806649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.806811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.806943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be updated. [ 760.844597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.844919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.845288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.845460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.845666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.855946] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: IN_PROGRESS for 2s [ 761.131047] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.131295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.131421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.131608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.131690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.131929] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.132055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.132129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.132295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.132422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.132520] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 is going to be updated. [ 761.166570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.166908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.166908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.167150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.167347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.178049] env[65660]: INFO networking_nsxv3.common.synchronization [req-b7dc65f6-8149-4fdb-aff7-fd899e64770d req-6eec5e46-1a3f-43f5-8d7d-4957dc64b2fd tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 761.178551] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 761.179963] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.179963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.180326] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 in Status: IN_PROGRESS for 2s [ 761.236184] env[65660]: INFO networking_nsxv3.common.synchronization [req-0a99103a-88aa-4c36-b40f-ce62b59f16fb req-50e2f001-fa76-4840-a33f-5bb1c7edc7ab tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 761.237514] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 761.237994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.238384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.238567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.239482] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.239825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.239825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.240098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.240301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.240446] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.744549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.744549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.744549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.744549] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be updated. [ 761.782225] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.782225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.782225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.782225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.782225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.792200] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 762.276177] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: UNINITIALIZED for 4s [ 762.289245] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 762.289810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.289810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.289970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.290182] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.290309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.290368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.290536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.290783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.290783] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.441553] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 762.441787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.441961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.442208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.442417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.442549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.442617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.442890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.442890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.442991] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.741984] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb0b9101-ad0a-43aa-956a-fddaffceadd9 req-ba61c999-bf4c-42d0-83f3-3da80e4d0ea2 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 762.742720] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 762.743210] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.743327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.743417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.743708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.743840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.743942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.743997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.744165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.744251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.744349] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.793138] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.826154] env[65660]: INFO networking_nsxv3.common.synchronization [req-ee7cca39-3961-48ac-8b24-96003677b609 req-99b13d29-5a18-4ec4-bfc0-9cb01c1230f2 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 762.826810] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 762.828029] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.828029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.828029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.828029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.828029] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.828504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.828504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.828616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.828616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.828733] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.859421] env[65660]: INFO networking_nsxv3.common.synchronization [req-ee7cca39-3961-48ac-8b24-96003677b609 req-99b13d29-5a18-4ec4-bfc0-9cb01c1230f2 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 762.859633] env[65660]: INFO networking_nsxv3.common.synchronization [req-ee7cca39-3961-48ac-8b24-96003677b609 req-99b13d29-5a18-4ec4-bfc0-9cb01c1230f2 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 762.859783] env[65660]: INFO networking_nsxv3.common.synchronization [req-ee7cca39-3961-48ac-8b24-96003677b609 req-99b13d29-5a18-4ec4-bfc0-9cb01c1230f2 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with Priority: HIGHEST for action port [ 762.861430] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 762.861586] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 762.861719] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with Priority: HIGHEST for action port [ 762.862831] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.862967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.863116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.863388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.863482] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.866545] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.866696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.866893] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.868288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.868288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.868288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.868288] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d896bf-7ef6-4421-9ebc-9a036f0f9c13',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.871261] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 762.871497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.871706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.871932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.872179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.872253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.872308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.872608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.872608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.872760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.872760] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.947143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.947334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.947431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.947666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.947767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.948226] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.948226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.948226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.948429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.948429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.948519] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 762.996036] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.996036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.996036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.996036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.996036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.006856] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 763.110696] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb0b9101-ad0a-43aa-956a-fddaffceadd9 req-80a9df88-5b01-46fa-a5d3-8075c22823d6 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 763.111677] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 763.112794] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.113579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.202453] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 in Status: SUCCESS [ 763.207443] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 775da0ad-e96e-41a5-a2df-bf309e71cba6 deletion is rescheduled due to dependency. [ 763.207443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-775da0ad-e96e-41a5-a2df-bf309e71cba6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.247143] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.256187] env[65660]: INFO networking_nsxv3.common.synchronization [req-9ce4aecb-8213-4078-a36d-c3bc9b2f74b0 req-3337c525-8172-4593-9642-4fb22f1d7dbe tempest-VolumesAssistedSnapshotsTest-18017522 tempest-VolumesAssistedSnapshotsTest-18017522-project-member] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_members [ 763.256885] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGHEST for action security_group_members [ 763.257312] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.257518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.257622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.258224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.258454] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.258599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.258713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.258975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.259649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.259649] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.297858] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.332217] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.367598] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.367761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.371095] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with status ACTIVE [ 763.371375] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.371476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.371515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.372281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.372281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.372281] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.372281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.372899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.372899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.372899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.372899] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.373085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.373085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.373225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.373256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.373714] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 is going to be updated. [ 763.378606] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.378868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.378868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.379169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.379475] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.379593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.380108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.380774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.380774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.380774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.380774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.380774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.381243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.381458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.381774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.381774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.381919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.382117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.382229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.382482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.382759] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.402955] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.404443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.404742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.405034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.405177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.405492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.424602] env[65660]: INFO networking_nsxv3.common.synchronization [req-eb0b9101-ad0a-43aa-956a-fddaffceadd9 req-3586476c-3ba7-476f-a308-12fbb55456bd tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 763.426096] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 763.426096] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.426216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.751574] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.761363] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.764049] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.764049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.764049] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c is going to be updated. [ 763.801706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.801706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.801706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.801706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.801706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.801706] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 763.805098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.805334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.805515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.805652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.805816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.807468] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 763.807621] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb deletion is rescheduled due to dependency. [ 763.807720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.826076] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c in Status: IN_PROGRESS for 2s [ 763.839759] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.859116] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.859782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.859782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.859782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.862585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.879627] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 763.885605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80: rpc.has_security_group_logging(os_id): False [ 763.909234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.909234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.909234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.909234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.909234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.909234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.909234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.909234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.910169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.910169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.910169] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.910169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.910169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.910169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.910169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.910386] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.910386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.910460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.911207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.911207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.911207] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be updated. [ 763.994856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.994856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.994856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.996446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.996688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.003566] env[65660]: INFO networking_nsxv3.common.synchronization [req-7407d2c9-3ddd-46c9-a113-9bc157ff565a req-b42274aa-a5fd-4df0-b2fa-afaddbbd3231 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 764.004255] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 764.006707] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.006883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.006936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.007191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.007418] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.007526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.007593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.007769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.007896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.007982] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.016273] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: IN_PROGRESS for 2s [ 764.176585] env[65660]: INFO networking_nsxv3.common.synchronization [req-b8ddd286-475b-47fd-859a-6a3fdd1c0fd7 req-4e83f633-908a-4f8e-be53-50081b65b486 tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 764.177020] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 764.177358] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.177490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.177575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.177794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.177946] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.178054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.178114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.178280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.178364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.178457] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.255371] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.255371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.255371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.255371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.255371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.255371] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 764.302786] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 764.303090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.303718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.304061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.304382] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.304605] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.304768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.306165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.306274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.306545] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.314031] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.315898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.315898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.315898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.316062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.338127] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 764.345910] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.345910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.346091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.348466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.348466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.348466] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 764.402425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.402425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.402425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.402425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.402425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.419175] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 764.514559] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.514726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.514794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.515023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.515108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.515308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.515402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.515461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.515611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.515680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.515760] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 764.581411] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.581831] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.582126] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.582546] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.582897] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.583123] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.583269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.583539] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.583712] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.583951] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.584095] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.584237] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.584371] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.586421] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.586421] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.586421] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.587055] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.587055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.587055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.587421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.587614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.605364] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 764.618591] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.618825] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.618963] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.621412] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-433" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.621819] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-e494af15-3eb0-4aae-8299-eed64ca91d77 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.622080] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.622210] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.622586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.622759] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e494af15-3eb0-4aae-8299-eed64ca91d77',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.680130] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.811398] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.019662] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 765.020684] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 deletion is rescheduled due to dependency. [ 765.020911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.124930] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.125168] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.125291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.126383] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.126383] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.126383] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port e494af15-3eb0-4aae-8299-eed64ca91d77 not found, creating... [ 765.126383] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.126570] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.126628] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.126837] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.126975] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.127274] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.127430] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.127532] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.127732] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.127867] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.128361] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: e494af15-3eb0-4aae-8299-eed64ca91d77 is going to be created. [ 765.152856] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.153560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.153560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.153560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.153906] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.154191] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.184392] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.314681] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.690211] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.690211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.690211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.690211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.690211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.690211] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 765.740960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.741220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.741329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.741637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.741842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.758027] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 765.817779] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.817982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.818087] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.818309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.818423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.819117] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be updated. [ 765.835076] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c in Status: SUCCESS [ 765.835316] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c deletion is rescheduled due to dependency. [ 765.835454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.851808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.852016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.852241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.852441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.852621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.864417] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: IN_PROGRESS for 2s [ 765.892195] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 765.892491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.892713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.893013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.893262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.893418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.893629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.893744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.895499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.895499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.895499] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.897712] env[65660]: INFO networking_nsxv3.common.synchronization [req-b8ddd286-475b-47fd-859a-6a3fdd1c0fd7 req-cc0ce211-ec86-4aaf-a54f-e320967ed9e5 service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 765.897982] env[65660]: INFO networking_nsxv3.common.synchronization [req-b8ddd286-475b-47fd-859a-6a3fdd1c0fd7 req-cc0ce211-ec86-4aaf-a54f-e320967ed9e5 service nova] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 765.898222] env[65660]: INFO networking_nsxv3.common.synchronization [req-b8ddd286-475b-47fd-859a-6a3fdd1c0fd7 req-cc0ce211-ec86-4aaf-a54f-e320967ed9e5 service nova] Enqueued Resource ID: e494af15-3eb0-4aae-8299-eed64ca91d77 with Priority: HIGHEST for action port [ 765.899755] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_rules [ 765.899755] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 765.899755] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e494af15-3eb0-4aae-8299-eed64ca91d77 with Priority: HIGHEST for action port [ 765.900268] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.900268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.900268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.905136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.905136] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.905136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.905136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.905136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e494af15-3eb0-4aae-8299-eed64ca91d77 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.905390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.905434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.906293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.906293] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e494af15-3eb0-4aae-8299-eed64ca91d77',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.031122] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 766.031486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.350347] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 766.350837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.350894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.351213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.351474] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.351648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.351749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.351992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.352163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.352326] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.401043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.401043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.401043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.401043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.401582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.401582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.401582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.401582] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.401695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.401733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.401950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.401950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.402044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.402152] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.412924] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.413101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.413848] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e494af15-3eb0-4aae-8299-eed64ca91d77 with status ACTIVE [ 766.414268] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.414403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.414474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.414691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.414786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.414908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.415064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.415121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.415254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.415373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.415624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.415919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.415919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.415990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.416028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.416381] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e494af15-3eb0-4aae-8299-eed64ca91d77 is going to be updated. [ 766.432284] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 766.432700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.433288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.433602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.433790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.433904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.434030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.434257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.434354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.434438] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.446449] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.446615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.446685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.446899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.447106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.448050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e494af15-3eb0-4aae-8299-eed64ca91d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.619194] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 766.619426] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb deletion is rescheduled due to dependency. [ 766.620861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.855183] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.858242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.858242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.858242] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 766.899337] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.899337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.899337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.899685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.900045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.906826] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 766.923120] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 766.933645] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.933860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.934050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.934180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.934297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.934631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.934761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.934830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.935358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.935358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.935521] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.935887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.935887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.935887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.935887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.936109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.936228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.936285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.936509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.936651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.936767] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 766.938240] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.027084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.027667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.027667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.027667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.028181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.048571] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 767.074349] env[65660]: INFO networking_nsxv3.common.synchronization [req-c59c0d26-2799-455d-9f1d-a329cee5e93b req-7da0a12a-7827-4426-ac6d-179008c97fe2 tempest-ServerRescueTestJSON-1602582723 tempest-ServerRescueTestJSON-1602582723-project-member] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 767.075035] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 767.075836] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.076056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.076174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.076528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.076933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.077114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.077213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.077450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.077587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.077722] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.432931] env[65660]: INFO networking_nsxv3.common.synchronization [req-cd55f146-4a7a-4de8-b9b0-eddd96bd7a33 req-953c98bd-a0c8-4d09-a704-77afcd7e94a7 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 767.433487] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 767.433893] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.434017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.440948] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.452254] env[65660]: INFO networking_nsxv3.common.synchronization [req-cd55f146-4a7a-4de8-b9b0-eddd96bd7a33 req-953c98bd-a0c8-4d09-a704-77afcd7e94a7 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 767.453677] env[65660]: INFO networking_nsxv3.common.synchronization [req-cd55f146-4a7a-4de8-b9b0-eddd96bd7a33 req-953c98bd-a0c8-4d09-a704-77afcd7e94a7 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 767.453785] env[65660]: INFO networking_nsxv3.common.synchronization [req-cd55f146-4a7a-4de8-b9b0-eddd96bd7a33 req-953c98bd-a0c8-4d09-a704-77afcd7e94a7 tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with Priority: HIGHEST for action port [ 767.455235] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_rules [ 767.455339] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 767.455682] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with Priority: HIGHEST for action port [ 767.456939] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.456939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.456939] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.456939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.456939] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.456939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.457238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.457238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.457293] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d896bf-7ef6-4421-9ebc-9a036f0f9c13',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.580537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.581609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.581609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.581609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.581609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.581609] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.581609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.581609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.581903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.581903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.581903] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa already deleted. [ 767.581903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.635997] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.636254] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.636391] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.636731] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.637025] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.638071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.638071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.638071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.638071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.638071] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.638071] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.638382] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.638382] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.638483] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.638528] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.638646] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.661053] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.661242] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.661375] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.661558] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.661894] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-4b914f56-97c4-49bb-9dae-b33061c25d4f taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.662080] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.662195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.662775] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.662775] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b914f56-97c4-49bb-9dae-b33061c25d4f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.772807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 767.773115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.773338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.773621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.773862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.774025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.775273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.775524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.775725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.775725] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.876850] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 767.876850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.876943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.877260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.877843] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.877843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.877843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.878152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.878194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.878312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.878448] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.944550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.944760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.944914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.945320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.945599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.945840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 767.960473] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 with status ACTIVE [ 767.960835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.960976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.961147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.961471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.961554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.961895] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.962091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.962232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.962507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.962678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.962967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.963158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.963302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.963632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.963717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.964088] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1d896bf-7ef6-4421-9ebc-9a036f0f9c13 is going to be updated. [ 767.992468] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.992468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.992769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.993220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.993433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.993704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1d896bf-7ef6-4421-9ebc-9a036f0f9c13" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.994992] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.995141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.995221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.995428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.995566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.019244] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 768.076695] env[65660]: INFO networking_nsxv3.common.synchronization [req-df334ca9-0054-457b-bdbc-3c7cf9d831ae req-fa9bc5a4-b54d-4b05-9534-d29d82d6df7d tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_members [ 768.077789] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGHEST for action security_group_members [ 768.078350] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.078698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.078698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.079197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.079197] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.079197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.079197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.079806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.079806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.079806] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.165237] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.165481] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.165586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.165867] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.166022] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.166178] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 4b914f56-97c4-49bb-9dae-b33061c25d4f not found, creating... [ 768.166435] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.166589] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.166699] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.166925] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.167058] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.167350] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.167482] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.167594] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.167802] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.167923] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.168070] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 4b914f56-97c4-49bb-9dae-b33061c25d4f is going to be created. [ 768.192787] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.193026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.193140] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.193517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.193886] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.194185] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.284484] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.382033] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.586135] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.586457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.586457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.586581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.586663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.586870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.586971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.587040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.587200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.587276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.587364] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 is going to be updated. [ 768.618830] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.619080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.619080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.619254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.619459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.627628] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 in Status: IN_PROGRESS for 2s [ 768.787342] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.885033] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86e61356-708b-403e-ad42-c5f9a1dc7099: rpc.has_security_group_logging(os_id): False [ 768.904925] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.905106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.905154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.905356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.905444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.905671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.905759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.905820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.905977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.906077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.906176] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be created. [ 768.934523] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 768.934825] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 deletion is rescheduled due to dependency. [ 768.934825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.935011] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.935218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.935402] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.935556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.935643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.935778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.935859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.935944] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.967097] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.967478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.967478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.967643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.967879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.980582] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: IN_PROGRESS for 2s [ 768.994024] env[65660]: INFO networking_nsxv3.common.synchronization [req-c59c0d26-2799-455d-9f1d-a329cee5e93b req-2030e04f-e309-4da8-aa2e-adf26d33569f service nova] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_rules [ 768.994024] env[65660]: INFO networking_nsxv3.common.synchronization [req-c59c0d26-2799-455d-9f1d-a329cee5e93b req-2030e04f-e309-4da8-aa2e-adf26d33569f service nova] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 768.994024] env[65660]: INFO networking_nsxv3.common.synchronization [req-c59c0d26-2799-455d-9f1d-a329cee5e93b req-2030e04f-e309-4da8-aa2e-adf26d33569f service nova] Enqueued Resource ID: 4b914f56-97c4-49bb-9dae-b33061c25d4f with Priority: HIGHEST for action port [ 768.994024] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_rules [ 768.994024] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 768.994024] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b914f56-97c4-49bb-9dae-b33061c25d4f with Priority: HIGHEST for action port [ 768.994617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.995053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.995220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.995645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.997062] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.997062] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.997062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.997062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.997465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.997761] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.997996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.998223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.998478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.998684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.998982] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.000142] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b914f56-97c4-49bb-9dae-b33061c25d4f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.000485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.001024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.001024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.001024] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b914f56-97c4-49bb-9dae-b33061c25d4f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.067214] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 769.067476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.259470] env[65660]: INFO networking_nsxv3.common.synchronization [req-8679119d-fe75-4f17-ae0d-33d8b2e0bf4a req-28e01954-89f9-4b6e-ba09-5ff62a93c650 tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 769.260130] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 769.260451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.260581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.260638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.260862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.261015] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.261117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.261178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.261335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.261426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.261528] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.291718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.291948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.291948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.292204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.292327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.292386] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 769.327025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.327172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.327251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.327482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.327633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.351113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 769.439013] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.439013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.439013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.439013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.439013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.439310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.439310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.439310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.439456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.439551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.439612] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 769.467785] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.468039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.468039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.468245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.468387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.478893] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 769.505960] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.505960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.505960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.505960] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b914f56-97c4-49bb-9dae-b33061c25d4f with status ACTIVE [ 769.505960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.505960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.505960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.505960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.505960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.506875] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.506875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.506875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.506875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.507079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.507246] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.507526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.507526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.507647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.507878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.508591] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b914f56-97c4-49bb-9dae-b33061c25d4f is going to be updated. [ 769.533200] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.533200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.533200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.533200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.533200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.533200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b914f56-97c4-49bb-9dae-b33061c25d4f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.765635] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.765635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.765635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.765635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.765635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.765635] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.765635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.765635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.766277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.766277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.766277] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 769.801894] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.802191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.802345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.802823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.802942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.816930] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 770.011480] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.032471] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 770.032647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.033413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.033535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.034301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.034301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.034301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.034301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.034301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.034301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.034301] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.035201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.035606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.035606] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.035720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.035720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.035888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.035961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.036366] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.328830] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 770.329065] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 770.329238] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_members [ 770.329878] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 770.331033] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 770.331033] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_members [ 770.331033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.331033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.331033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.331033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.331435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.331435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.331435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.331999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.331999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.331999] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.333340] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.333483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.333574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.333795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.333971] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.334108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.334177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.334358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.334447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.334576] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.335640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7225c205-75ce-4814-9b8b-d2f62437ad9f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.335719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.335892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.336084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.336272] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.336382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.336447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.337036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.337036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.337036] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_rules [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_members [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_rules [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [req-74f0fe66-19b4-4d08-a855-afe6339b4cac req-f897e76c-8735-428d-be74-310bf259dbe6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 with Priority: HIGHEST for action port [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_rules [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_rules [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 with Priority: HIGHEST for action port [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_rules [ 770.392976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_members [ 770.393682] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 770.393682] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7225c205-75ce-4814-9b8b-d2f62437ad9f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.393682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.394092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.394397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.394482] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.395773] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.395878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.396088] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.396171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.397365] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a776a8-67c4-4cdf-8e85-540627d2f790 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.397480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.397549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.397737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.397817] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a776a8-67c4-4cdf-8e85-540627d2f790',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.398649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.399351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.399351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.399351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.399351] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.400028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7225c205-75ce-4814-9b8b-d2f62437ad9f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.400028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.401911] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.401911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.513227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.513525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.513701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.514110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.514278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.514336] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be created. [ 770.538658] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.539546] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.559736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.559736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.559736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.559736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.560915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.576165] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: UNINITIALIZED for 2s [ 770.642626] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 in Status: SUCCESS [ 770.642846] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 deletion is rescheduled due to dependency. [ 770.642965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.659838] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:0 completed [ 770.659988] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:1 started [ 770.838753] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.840304] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.841295] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.903095] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.903095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.903095] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7225c205-75ce-4814-9b8b-d2f62437ad9f taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.903095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.903095] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4a776a8-67c4-4cdf-8e85-540627d2f790 with status ACTIVE [ 770.903095] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.903095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.903095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.906437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.906437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.906437] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.906437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.906437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.906437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.906437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.907233] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.907850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.908073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.909935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.909935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.909935] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4a776a8-67c4-4cdf-8e85-540627d2f790 is going to be updated. [ 770.937254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.937254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.937254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.939294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.942683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.943059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a776a8-67c4-4cdf-8e85-540627d2f790" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.028631] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 771.029061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.029396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.031381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.031381] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.044150] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.045076] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 575bfa27-1492-4754-bbae-fa15d2d40215: rpc.has_security_group_logging(os_id): False [ 771.067477] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.067685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.067685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.067906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.068019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.068291] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.068391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.068467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.068634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.068702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.068789] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 771.151912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.152135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.152317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.152620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.152797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.173795] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 771.342178] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.343754] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.347084] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.362926] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 771.363218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.363402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.363645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.363890] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.364103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.364217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.364480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.364614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.364761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.364900] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.492900] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 771.492900] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 deletion is rescheduled due to dependency. [ 771.492900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.532794] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.533439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.550675] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.550675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.550675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.550675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.550675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.550675] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 771.595658] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.595864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.596091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.596274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.596477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.608115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 771.829276] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 771.829484] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 771.829615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.847087] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.847336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.847336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.847593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.847654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.847723] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be updated. [ 771.849553] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.850421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.850421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.850421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.850421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.850421] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 771.854362] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.854362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.854362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.854362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.854362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.854362] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f is going to be created. [ 771.868053] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.868662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.868853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.869115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.869549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.869672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.869672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.869915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.870068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.870273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.870474] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.870639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.870746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.870989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.871250] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.871407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.871524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.871876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.871995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.872175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.872347] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.893330] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.893330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.893330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.893574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.893574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.901962] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.901962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.904043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.904043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.904043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.911218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.912512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.912512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.912512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.912512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.915232] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f in Status: UNINITIALIZED for 2s [ 771.928448] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 771.928448] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: IN_PROGRESS for 2s [ 772.379352] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da44bcac-8dcd-43ae-b931-eee44940a29b: rpc.has_security_group_logging(os_id): False [ 772.414636] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.414636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.414636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.415336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.415336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.416771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.416933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.418423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.418925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.418994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.419442] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.419962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.420146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.421173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.421377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.422592] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.422729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.422824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.423150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.423308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.423453] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 772.516167] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.516167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.516167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.516167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.516167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.531408] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 772.591193] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.591193] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.591193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.591193] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.703604] env[65660]: INFO networking_nsxv3.common.synchronization [req-ab636d60-14ab-4261-9a96-cef771d4498e req-64fdaf78-6dd4-4203-8392-f937b20d6c60 tempest-ListServerFiltersTestJSON-1195138828 tempest-ListServerFiltersTestJSON-1195138828-project-member] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 772.705211] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 772.705995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.706389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.706639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.707249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.708230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.708230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.708230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.708230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.708656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.709292] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.095153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.095153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.095153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.095153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.095905] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.095905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.095905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.098022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.098022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.098022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.098022] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.190764] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 773.191099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.191338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.191619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.191738] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.211202] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.603405] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa: rpc.has_security_group_logging(os_id): False [ 773.619579] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 773.619839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.620043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.620304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.620543] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.620729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.620845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.621054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.621151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.621248] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.624132] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.624281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.624359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.624806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.624901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.625265] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.625265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.625405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.625497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.625581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.626042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.626148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.626213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.626370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.626430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.626665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.626744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.626744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.627073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.627164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.627252] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be created. [ 773.687191] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.687409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.687409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.687654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.687840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.695404] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.695744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.702042] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: IN_PROGRESS for 2s [ 773.713679] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.721297] env[65660]: INFO networking_nsxv3.common.synchronization [None req-21eb8a77-768a-4998-b5b1-18cfca90ddc8 None None] Enqueued Resource ID: 2c6a9ef4-3da6-48a4-9410-dbd2d83e9152 with Priority: HIGHEST for action port [ 773.721297] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6a9ef4-3da6-48a4-9410-dbd2d83e9152 with Priority: HIGHEST for action port [ 773.721297] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c6a9ef4-3da6-48a4-9410-dbd2d83e9152 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.721297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c6a9ef4-3da6-48a4-9410-dbd2d83e9152" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.721297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c6a9ef4-3da6-48a4-9410-dbd2d83e9152" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.721297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c6a9ef4-3da6-48a4-9410-dbd2d83e9152" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.721297] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6a9ef4-3da6-48a4-9410-dbd2d83e9152',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.783441] env[65660]: INFO networking_nsxv3.common.synchronization [req-b9283c77-7b74-4cf4-8d7d-244220ca093c req-37ec8be3-1a79-44cf-8e11-890660191e5c tempest-AttachInterfacesUnderV243Test-153791295 tempest-AttachInterfacesUnderV243Test-153791295-project-member] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 773.783883] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGHEST for action security_group_members [ 773.784440] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.784536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.931929] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f in Status: SUCCESS [ 773.931929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.934304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.934304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.934304] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.934304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.934304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.934304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.934304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.936158] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.946948] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 773.947273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.948504] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 773.948661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.949941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.949941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.949941] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.949941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.949941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.953756] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.953756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.953756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.953756] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.124465] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.217551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.217716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.217788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.218000] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.218105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.218580] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 774.222324] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c6a9ef4-3da6-48a4-9410-dbd2d83e9152 [ 774.222324] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.222473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.222626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.222737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.222889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.222935] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c6a9ef4-3da6-48a4-9410-dbd2d83e9152 already deleted. [ 774.222978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c6a9ef4-3da6-48a4-9410-dbd2d83e9152" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.255467] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.255467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.255467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.255467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.255467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.270363] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 774.443023] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.457511] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.459057] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.549647] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 774.549890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.629325] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.943027] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.962187] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.963206] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.130293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.130674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.130674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.130763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.130839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.130936] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 775.158734] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.158918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.158965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.159190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.159301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.170486] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 775.445617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.445882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.445964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.446300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.446426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.448381] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f is going to be updated. [ 775.467361] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.467361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.467361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.467361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.467361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.467361] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be updated. [ 775.468424] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.468645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.468754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.468974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.469678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.469838] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 775.487104] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.487238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.487295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.488034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.488034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.497164] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f in Status: IN_PROGRESS for 2s [ 775.508345] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.508496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.508542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.509564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.509564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.510723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.510854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.510925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.511126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.511250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.523217] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: IN_PROGRESS for 2s [ 775.524700] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 775.652393] env[65660]: INFO networking_nsxv3.common.synchronization [None req-009cac9a-7a0b-4ac1-850d-b2a13dd917fe tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 775.652967] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 775.653349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.653473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.653473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.653761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.653820] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.717593] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 775.717830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.825928] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6d4aed4c-110a-4043-b09e-82fd83ed4b27 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 775.825928] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 775.825928] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.825928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.177641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.178083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.178083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.178083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.178500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.178500] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 already deleted. [ 776.178500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.178942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.179648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.179648] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.281115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 776.281283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.348907] env[65660]: INFO networking_nsxv3.common.synchronization [None req-0f5fd867-9d7f-4778-ae68-6472a9454d37 None None] Enqueued Resource ID: 3d20d95e-89ab-4dd5-9eab-dcd8f34f5617 with Priority: HIGHEST for action port [ 776.348907] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d20d95e-89ab-4dd5-9eab-dcd8f34f5617 with Priority: HIGHEST for action port [ 776.348907] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d20d95e-89ab-4dd5-9eab-dcd8f34f5617 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.348907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d20d95e-89ab-4dd5-9eab-dcd8f34f5617" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.348907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d20d95e-89ab-4dd5-9eab-dcd8f34f5617" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.348907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d20d95e-89ab-4dd5-9eab-dcd8f34f5617" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.348907] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d20d95e-89ab-4dd5-9eab-dcd8f34f5617',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.700190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.700358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.700446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.700714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.700829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.700938] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 already deleted. [ 776.700977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.851322] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d20d95e-89ab-4dd5-9eab-dcd8f34f5617 [ 776.851611] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.851839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.852159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.852273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.852380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.852548] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d20d95e-89ab-4dd5-9eab-dcd8f34f5617 already deleted. [ 776.852656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d20d95e-89ab-4dd5-9eab-dcd8f34f5617" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.183019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.183019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.183019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.183019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.184067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.184336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.184579] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.184782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.184914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.185141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.185299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.185455] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.461811] env[65660]: INFO networking_nsxv3.common.synchronization [req-bc04085a-a5ae-4715-9e0b-7717baaf4dce req-a764e8b1-fd14-41cc-a869-2a678139a1c6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 777.462023] env[65660]: INFO networking_nsxv3.common.synchronization [req-bc04085a-a5ae-4715-9e0b-7717baaf4dce req-a764e8b1-fd14-41cc-a869-2a678139a1c6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 777.462159] env[65660]: INFO networking_nsxv3.common.synchronization [req-bc04085a-a5ae-4715-9e0b-7717baaf4dce req-a764e8b1-fd14-41cc-a869-2a678139a1c6 tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_members [ 777.462727] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 777.462838] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGHEST for action security_group_members [ 777.463988] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f with Priority: HIGHEST for action security_group_members [ 777.468024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.468024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.468024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.468024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.468024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-7225c205-75ce-4814-9b8b-d2f62437ad9f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.468024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.510817] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f in Status: SUCCESS [ 777.511084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.511422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.511545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.511822] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.511972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.512066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.512259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.512345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.512464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.512599] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.513545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.513731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.514642] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.514642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.514642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.514642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.515171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.515171] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.537803] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 777.537989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.541084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.541337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.541538] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.541657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.541721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.541876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.541960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.542063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.542162] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.543868] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 777.544096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.545301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.545522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.545710] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.545875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.545977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.546184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.546284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.546365] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.547184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.548029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.548332] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.548449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.548507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.549230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.549314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.549442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.549581] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.551229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.551392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.551554] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.551664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.551720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.551853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.551932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.552412] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.687557] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.688715] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.689025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.689198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.689643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.689643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.689643] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.689812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.689812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.689870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.689932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.690104] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 777.754317] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.754441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.754441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.755317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.755317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.788551] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 777.859779] env[65660]: INFO networking_nsxv3.common.synchronization [None req-12a6bc54-d8ac-46f1-af8f-4f28771fd954 None None] Enqueued Resource ID: 2035ace4-f233-4b0c-9d6a-30008189e5ac with Priority: HIGHEST for action port [ 777.860070] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2035ace4-f233-4b0c-9d6a-30008189e5ac with Priority: HIGHEST for action port [ 777.860823] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2035ace4-f233-4b0c-9d6a-30008189e5ac taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.860954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2035ace4-f233-4b0c-9d6a-30008189e5ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.861069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2035ace4-f233-4b0c-9d6a-30008189e5ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.861782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2035ace4-f233-4b0c-9d6a-30008189e5ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.861782] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2035ace4-f233-4b0c-9d6a-30008189e5ac',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.017637] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7225c205-75ce-4814-9b8b-d2f62437ad9f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.021338] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.021972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.021972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.021972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.021972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.022174] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.022174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.022272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.022404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.022459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.022559] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f is going to be deleted. [ 778.052265] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.053453] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.053612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.053657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.053857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.053951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.054152] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.054247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.054307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.054463] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.054538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.054622] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be updated. [ 778.056422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.056533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.057378] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.084785] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.084956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.085031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.086778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.086778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.093623] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.093803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.093854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.094076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.094170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.094272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.102852] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: IN_PROGRESS for 2s [ 778.192123] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 575bfa27-1492-4754-bbae-fa15d2d40215: rpc.has_security_group_logging(os_id): False [ 778.215116] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.215343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.215343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.215535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.215606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.215864] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.216372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.216437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.216484] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be updated. [ 778.275667] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.276153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.276153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.276890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.276890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.291747] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: IN_PROGRESS for 2s [ 778.365040] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2035ace4-f233-4b0c-9d6a-30008189e5ac [ 778.365040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.365040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.365040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.365430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.365430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.365430] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2035ace4-f233-4b0c-9d6a-30008189e5ac already deleted. [ 778.365430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2035ace4-f233-4b0c-9d6a-30008189e5ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.522538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7225c205-75ce-4814-9b8b-d2f62437ad9f: rpc.has_security_group_logging(os_id): False [ 778.541576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.541735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.541834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.542046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.542145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.542398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.542540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.542614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.542796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.542868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.542961] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f is going to be created. [ 778.557055] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86e61356-708b-403e-ad42-c5f9a1dc7099: rpc.has_security_group_logging(os_id): False [ 778.560860] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.565795] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7225c205-75ce-4814-9b8b-d2f62437ad9f], does not exist path=[/infra/domains/default/groups/7225c205-75ce-4814-9b8b-d2f62437ad9f]."\n}' [ 778.565795] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7225c205-75ce-4814-9b8b-d2f62437ad9f [ 778.565795] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 778.576597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.576947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.576947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.577086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.577876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.577876] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.577876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.577876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.577876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.577876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.578152] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be updated. [ 778.609319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.609980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.609980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.609980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.611517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.611896] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.612167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.612362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.612601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.612720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.612997] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.613147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.613302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.613550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.613619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.613749] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7225c205-75ce-4814-9b8b-d2f62437ad9f is going to be created. [ 778.638266] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7225c205-75ce-4814-9b8b-d2f62437ad9f], does not exist path=[/infra/domains/default/groups/7225c205-75ce-4814-9b8b-d2f62437ad9f]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7225c205-75ce-4814-9b8b-d2f62437ad9f [ 778.638266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7225c205-75ce-4814-9b8b-d2f62437ad9f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.638536] env[65660]: Traceback (most recent call last): [ 778.638536] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 778.638536] env[65660]: return func(*args, **kwargs) [ 778.638536] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 778.638536] env[65660]: res.raise_for_status() [ 778.638536] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 778.638536] env[65660]: raise HTTPError(http_error_msg, response=self) [ 778.638536] env[65660]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7225c205-75ce-4814-9b8b-d2f62437ad9f [ 778.638808] env[65660]: During handling of the above exception, another exception occurred: [ 778.638808] env[65660]: Traceback (most recent call last): [ 778.638808] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 778.638808] env[65660]: listener.cb(fileno) [ 778.638808] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 778.638808] env[65660]: result = function(*args, **kwargs) [ 778.638808] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 778.638808] env[65660]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 778.638808] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 778.638808] env[65660]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 778.638808] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 778.638808] env[65660]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 778.638808] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 778.638808] env[65660]: res.raise_for_status() [ 778.638808] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 778.638808] env[65660]: raise HTTPError(http_error_msg, response=self) [ 778.638808] env[65660]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7225c205-75ce-4814-9b8b-d2f62437ad9f [ 778.638808] env[65660]: Removing descriptor: 19 [ 778.640574] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.640809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.640909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.641179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.641394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.658375] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: IN_PROGRESS for 2s [ 779.063866] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.063866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.063866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.064115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.064186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.064312] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 779.097107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.097451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.097580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.097922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.098113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.115572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 779.800366] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 779.800366] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 deletion is rescheduled due to dependency. [ 779.800366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.114578] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 780.114764] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 deletion is rescheduled due to dependency. [ 780.114880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.306228] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 575bfa27-1492-4754-bbae-fa15d2d40215 in Status: SUCCESS [ 780.306600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.444526] env[65660]: INFO networking_nsxv3.common.synchronization [None req-92079ef3-5694-498c-9021-5e42488a83e7 tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 780.445357] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 780.445997] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.446298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.446298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.446828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.446828] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.676413] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 in Status: SUCCESS [ 780.676635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.757991] env[65660]: INFO networking_nsxv3.common.synchronization [None req-07c655b4-da90-454e-b37e-3bc0e758f394 None None] Enqueued Resource ID: b5272257-a50c-4fce-b934-2705f8b63a96 with Priority: HIGHEST for action port [ 780.759492] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5272257-a50c-4fce-b934-2705f8b63a96 with Priority: HIGHEST for action port [ 780.759492] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5272257-a50c-4fce-b934-2705f8b63a96 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.759492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5272257-a50c-4fce-b934-2705f8b63a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.759492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5272257-a50c-4fce-b934-2705f8b63a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.759492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5272257-a50c-4fce-b934-2705f8b63a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.759492] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5272257-a50c-4fce-b934-2705f8b63a96',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.970422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.970687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.970687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.970968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.971096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.971219] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d already deleted. [ 780.971397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.988466] env[65660]: INFO networking_nsxv3.common.synchronization [None req-9373eda2-919e-452a-8dc5-b51c84736eac tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 780.989191] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 780.989581] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.989742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.989872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.990071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.990205] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.072931] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6d307f23-4cb4-4a70-8c15-21d089b7a221 None None] Enqueued Resource ID: a8178af3-46e8-47d5-a517-a059be61c812 with Priority: HIGHEST for action port [ 781.073433] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8178af3-46e8-47d5-a517-a059be61c812 with Priority: HIGHEST for action port [ 781.073888] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8178af3-46e8-47d5-a517-a059be61c812 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.073888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8178af3-46e8-47d5-a517-a059be61c812" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.074037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8178af3-46e8-47d5-a517-a059be61c812" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.074250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8178af3-46e8-47d5-a517-a059be61c812" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.074358] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8178af3-46e8-47d5-a517-a059be61c812',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.124957] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 781.125177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.125345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.125570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.125759] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.125873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.125935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.126113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.126187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.126273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.126425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.126532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.126653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.126792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.126932] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.127036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.127096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.127228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.127300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.127379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.127467] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.261544] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5272257-a50c-4fce-b934-2705f8b63a96 [ 781.261686] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.261934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.262028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.262254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.262357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.262451] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5272257-a50c-4fce-b934-2705f8b63a96 already deleted. [ 781.262629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5272257-a50c-4fce-b934-2705f8b63a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.520017] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.521281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.521281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.521281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.521281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.521281] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d already deleted. [ 781.521281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.576845] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8178af3-46e8-47d5-a517-a059be61c812 [ 781.577178] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.577330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.577393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.577767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.577865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.578083] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8178af3-46e8-47d5-a517-a059be61c812 already deleted. [ 781.578159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8178af3-46e8-47d5-a517-a059be61c812" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.630220] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 781.651789] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.651961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.652077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.652356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.677239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.677239] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.677373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.677373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.677511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.677645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.678139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.678336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.678575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.678575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.678794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.678847] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.679037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.679037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.679390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.679390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.679390] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 781.754541] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.754730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.755274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.755274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.755274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.777239] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 782.985435] env[65660]: INFO networking_nsxv3.common.synchronization [None req-3f8d8d00-463b-4a5d-8bce-98c957529cc8 None None] Enqueued Resource ID: ce4eeff4-c2f5-425c-9f6f-6c0991134300 with Priority: HIGHEST for action port [ 782.987426] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4eeff4-c2f5-425c-9f6f-6c0991134300 with Priority: HIGHEST for action port [ 782.987426] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce4eeff4-c2f5-425c-9f6f-6c0991134300 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.987426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce4eeff4-c2f5-425c-9f6f-6c0991134300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.987426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce4eeff4-c2f5-425c-9f6f-6c0991134300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.989411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce4eeff4-c2f5-425c-9f6f-6c0991134300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.989565] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4eeff4-c2f5-425c-9f6f-6c0991134300',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.492874] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce4eeff4-c2f5-425c-9f6f-6c0991134300 [ 783.493165] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.493362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.493455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.493815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.493914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.493950] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce4eeff4-c2f5-425c-9f6f-6c0991134300 already deleted. [ 783.494073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce4eeff4-c2f5-425c-9f6f-6c0991134300" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.794507] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 783.794854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.605497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.605497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.605497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.605497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.605497] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.012870] env[65660]: INFO networking_nsxv3.common.synchronization [None req-da6706b6-ed6e-4bd3-b407-123678065c19 None None] Enqueued Resource ID: 9306400e-2eca-49fb-ad5e-93387b7b1d3d with Priority: HIGHEST for action port [ 786.013479] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9306400e-2eca-49fb-ad5e-93387b7b1d3d with Priority: HIGHEST for action port [ 786.014157] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9306400e-2eca-49fb-ad5e-93387b7b1d3d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.014157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9306400e-2eca-49fb-ad5e-93387b7b1d3d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.016095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9306400e-2eca-49fb-ad5e-93387b7b1d3d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.016744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9306400e-2eca-49fb-ad5e-93387b7b1d3d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.016744] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9306400e-2eca-49fb-ad5e-93387b7b1d3d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.106756] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.519959] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9306400e-2eca-49fb-ad5e-93387b7b1d3d [ 786.520213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.520348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.520411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.520665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.520758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.520855] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9306400e-2eca-49fb-ad5e-93387b7b1d3d already deleted. [ 786.520931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9306400e-2eca-49fb-ad5e-93387b7b1d3d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.611121] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.114509] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 787.115012] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 787.435916] env[65660]: INFO networking_nsxv3.common.synchronization [req-d54b489a-7f9d-45db-9020-17a4605dd6c7 req-5f4be657-7931-4b8f-88e0-838c0dcddf63 tempest-ServerTagsTestJSON-184075780 tempest-ServerTagsTestJSON-184075780-project-member] Enqueued Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_members [ 787.436669] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGHEST for action security_group_members [ 787.436776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.436892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.438069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.438069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.438069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.438069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.438069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.438069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.438069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.438069] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.941462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.941462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.941462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.941978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.050149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.050149] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.050149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.050149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.050149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.050149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.050149] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6705170-58ac-456b-99c6-9d36829cfeca is going to be updated. [ 788.098455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.098923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.098923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.099117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.099183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.117088] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6705170-58ac-456b-99c6-9d36829cfeca in Status: IN_PROGRESS for 2s [ 788.500332] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.501159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.501385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.501710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.686091] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 788.687299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.688934] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 788.732267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.732267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.732267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.732267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.739245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.739478] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 788.739478] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.739654] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 788.792098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.792286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.792330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.792542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.793480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.793695] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 788.872362] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.872514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.872583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.873037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.873326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.873573] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 788.957905] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.958826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.959050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.960078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.960961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.961576] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 788.961798] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'65621639-622d-4f5b-8229-eb6bfdd2fa83', '8c31855b-36a6-4c63-86d7-83465075aed8', '1bb1aae9-5e28-4517-b1d1-0a8a052663cb', '8b2dca75-cd86-462e-b41c-7286490b3384', 'eaef59ac-b94f-47d8-8852-ec864d2e9eeb', 'a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d', '8c9e0656-5fea-404b-bf7f-6b1310cebf25', '8f87a553-f0af-4b3c-a4c8-027ffa03572b', '9ea6f6a9-d971-4d60-9de9-fb59a5a466c5', '7f796b38-dca5-4730-a81c-cd9714b3ab8d', 'a4849bc3-c5eb-4d2a-b87d-61a1b4e18236', '2f0605a5-c443-4058-aec5-d5357dce9d2e', '4e872372-e4f2-43b5-922d-ee045d8baf5b', '5bf0f4a4-4808-4a1d-a832-54c26e813f60', '335a6866-6ca7-4c63-a411-59c67e151de0', '2c5cc4f2-b09e-4802-8402-1b312af39573', '39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82', '384c91ff-3865-47c2-b54a-ade5d4bb5f41', 'a4952419-31e9-43c3-93de-73b6983584c2', '769f17ed-cec0-4733-bb67-f90cba106a02', '5075ffdb-26d9-4c45-8f12-db06f5a52322', 'db90b51b-f35c-42cc-8ed2-59a87f10bd43', 'cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a', 'da44bcac-8dcd-43ae-b931-eee44940a29b', '1dbcba73-4b06-4756-bd56-81b58777d093', '0a8aaa9b-7467-48c3-bfb1-e630aeec084c', 'f6705170-58ac-456b-99c6-9d36829cfeca', 'a30035af-7284-45ea-aa1f-a189cf5311fc', '3b7c0cba-3688-4cc0-935f-a2d962d5bcb6', '6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80', 'ef75b626-5ac5-4f1b-bccb-30d1c66c9174', '575bfa27-1492-4754-bbae-fa15d2d40215', '86e61356-708b-403e-ad42-c5f9a1dc7099', '5546cce7-b8e5-406f-8abd-1541b01097c9', 'a92ae96e-10c4-4e29-8e7f-609600f2de2e', 'e668c0d3-6bc9-4aa1-941b-9707aedef834', 'dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a', '775da0ad-e96e-41a5-a2df-bf309e71cba6', 'df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa'} {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.962098] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 788.985333] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.985507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.985567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.985786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.985865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.985898] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 788.985968] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.986047] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 789.066023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.066253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.066253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.066466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.067233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.067442] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 789.067516] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 789.067602] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 789.067677] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 789.067752] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 789.067811] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGH for action security_group_rules [ 789.067865] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGH for action security_group_rules [ 789.067952] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGH for action security_group_rules [ 789.068039] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGH for action security_group_rules [ 789.068143] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGH for action security_group_rules [ 789.068143] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGH for action security_group_rules [ 789.068496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGH for action security_group_rules [ 789.068496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGH for action security_group_rules [ 789.068496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGH for action security_group_rules [ 789.068496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGH for action security_group_rules [ 789.068496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGH for action security_group_rules [ 789.068496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGH for action security_group_rules [ 789.069526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.525917] env[65660]: INFO networking_nsxv3.common.synchronization [req-dbd2e3f2-033b-4a27-a26c-0b4cc68c485a req-2a1f4bae-7d13-485a-a6c0-a95e3d77e2ca tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 789.526693] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 789.527017] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 with Priority: HIGH for action security_group_rules [ 789.527207] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGH for action security_group_rules [ 789.527318] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 with Priority: HIGH for action security_group_rules [ 789.527454] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGH for action security_group_rules [ 789.527586] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769f17ed-cec0-4733-bb67-f90cba106a02 with Priority: HIGH for action security_group_rules [ 789.527716] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4952419-31e9-43c3-93de-73b6983584c2 with Priority: HIGH for action security_group_rules [ 789.527847] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGH for action security_group_rules [ 789.527977] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGH for action security_group_rules [ 789.528208] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGH for action security_group_rules [ 789.528348] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 with Priority: HIGH for action security_group_rules [ 789.528477] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGH for action security_group_rules [ 789.528605] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e with Priority: HIGH for action security_group_rules [ 789.528737] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGH for action security_group_rules [ 789.528940] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d with Priority: HIGH for action security_group_rules [ 789.529101] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGH for action security_group_rules [ 789.529231] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d with Priority: HIGH for action security_group_rules [ 789.529362] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b with Priority: HIGH for action security_group_rules [ 789.529510] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGH for action security_group_rules [ 789.530073] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGH for action security_group_rules [ 789.530250] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2dca75-cd86-462e-b41c-7286490b3384 with Priority: HIGH for action security_group_rules [ 789.530615] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.530753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.530822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.531186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.531367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.531471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.531534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.531750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.531853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.531970] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.533574] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65621639-622d-4f5b-8229-eb6bfdd2fa83 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.533752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.533752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.533887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.533962] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65621639-622d-4f5b-8229-eb6bfdd2fa83',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.535211] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.535211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.535211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.535211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.535376] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.536133] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.536244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.536310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.536460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.536531] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c9e0656-5fea-404b-bf7f-6b1310cebf25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.537604] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.537715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.537780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.537988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.538126] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.539377] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-769f17ed-cec0-4733-bb67-f90cba106a02 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.539491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.539556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539822] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('769f17ed-cec0-4733-bb67-f90cba106a02',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.540745] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4952419-31e9-43c3-93de-73b6983584c2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.541050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.542745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.545291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.545381] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4952419-31e9-43c3-93de-73b6983584c2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.546748] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.546748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.546748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.546943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.546974] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.548736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.548736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.548736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.548736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.548736] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.549662] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.549785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.550573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.550573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.550573] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.551136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c5cc4f2-b09e-4802-8402-1b312af39573 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.551235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.552131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.552131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.552131] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c5cc4f2-b09e-4802-8402-1b312af39573',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.552311] env[65660]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 789.553344] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.553477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.553788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.554057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.554057] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.556760] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f0605a5-c443-4058-aec5-d5357dce9d2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.556760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.556760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.556760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.556760] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f0605a5-c443-4058-aec5-d5357dce9d2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.557703] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.557703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.557703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.557836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.557836] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.558693] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.558795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.558919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.559393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.559393] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f796b38-dca5-4730-a81c-cd9714b3ab8d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.560458] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.560458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.560458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.560458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.560458] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.562990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.564273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.564385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.564612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.564612] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.565758] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.565852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.565912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.566433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.566433] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f87a553-f0af-4b3c-a4c8-027ffa03572b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.567164] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.567292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.567348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.567484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.567562] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.569103] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.569103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.569103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.569103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.569103] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.570207] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2dca75-cd86-462e-b41c-7286490b3384 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.570356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.570512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.570648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.570727] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2dca75-cd86-462e-b41c-7286490b3384',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.570945] env[65660]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 789.580800] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b07b1f58-fcbe-46c1-977b-7019c2178b17 None None] Enqueued Resource ID: 4a7212ac-0694-4e03-a68b-0f6f5a5a8897 with Priority: HIGHEST for action port [ 789.585253] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7212ac-0694-4e03-a68b-0f6f5a5a8897 with Priority: HIGHEST for action port [ 789.588290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7212ac-0694-4e03-a68b-0f6f5a5a8897 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.588290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7212ac-0694-4e03-a68b-0f6f5a5a8897" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.588405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7212ac-0694-4e03-a68b-0f6f5a5a8897" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.588695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7212ac-0694-4e03-a68b-0f6f5a5a8897" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.588811] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7212ac-0694-4e03-a68b-0f6f5a5a8897',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.612698] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.612853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.612915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.613142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.653648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.653648] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65621639-622d-4f5b-8229-eb6bfdd2fa83 is going to be deleted. [ 789.728092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.728286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.728343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.728512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.728605] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.728880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65621639-622d-4f5b-8229-eb6bfdd2fa83" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.959452] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.959870] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.959870] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.960217] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.960704] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.960889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.961043] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.961374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.961622] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.961874] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.962017] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.962165] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.962349] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.962544] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.962669] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.962846] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.014575] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.014767] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.014944] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.015141] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.015495] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-c292d803-5d82-4499-a914-146f089c5cd7 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.015803] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.015953] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.016919] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.017244] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c292d803-5d82-4499-a914-146f089c5cd7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.075428] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.075556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.076222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.076222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.095416] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a7212ac-0694-4e03-a68b-0f6f5a5a8897 [ 790.095839] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.096083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.096224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.096502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.096636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.096755] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a7212ac-0694-4e03-a68b-0f6f5a5a8897 already deleted. [ 790.096888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7212ac-0694-4e03-a68b-0f6f5a5a8897" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.107418] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.107621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.112282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.112701] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.112900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.112973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.113251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.113377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.113561] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 790.115155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.115400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.119615] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.120053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.120217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.120598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.120895] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.121173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.121310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.121591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.122187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.122187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.122187] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.130518] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.130518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.130518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.131242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.131242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.131525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.131525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.131610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.131690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.131728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.131950] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.139843] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.140168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.140168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.140418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.140624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.140624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.140874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.141023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.141080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.141189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.141349] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.144052] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.144215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.144286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.144476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.144667] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.144826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.144893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.145064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.145152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.145271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.145358] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.152061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.152268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.152342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.152579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.152760] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.152862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.152922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.153128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.153222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.153382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.153463] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.165582] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.165582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.173530] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.180286] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.180491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.180491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.180699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.180891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.205635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.205948] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be deleted. [ 790.207394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.208113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.212041] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.212271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.222855] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6705170-58ac-456b-99c6-9d36829cfeca in Status: SUCCESS [ 790.223121] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6705170-58ac-456b-99c6-9d36829cfeca deletion is rescheduled due to dependency. [ 790.223205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.225439] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.225439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.230638] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.230638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.230937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.231088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.232889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.233082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.234170] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.234170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.235993] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.236161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.238202] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.239034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.240384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.240682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.242063] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.242063] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 790.253099] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.253859] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.254235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.255451] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.257623] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.257623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.257766] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.258378] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.258483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.261014] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.261662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.262131] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f87a553-f0af-4b3c-a4c8-027ffa03572b is going to be deleted. [ 790.263204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.263745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.315597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.315906] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c5cc4f2-b09e-4802-8402-1b312af39573 is going to be deleted. [ 790.316955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.317530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.370455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.370455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.372781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.372781] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4952419-31e9-43c3-93de-73b6983584c2 is going to be deleted. [ 790.373503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.373826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.378174] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.378354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.462046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.462046] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be deleted. [ 790.462314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.462524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.488587] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.488857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.520417] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.520684] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.520873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.521219] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.521366] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.521820] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port c292d803-5d82-4499-a914-146f089c5cd7 not found, creating... [ 790.521820] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.522079] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.522138] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.522334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.522491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.522920] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.523139] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.523234] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.523451] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.523627] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.523796] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: c292d803-5d82-4499-a914-146f089c5cd7 is going to be created. [ 790.548047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.548047] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c9e0656-5fea-404b-bf7f-6b1310cebf25 is going to be deleted. [ 790.548673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.548943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.563571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.563571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.625743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.625923] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f0605a5-c443-4058-aec5-d5357dce9d2e is going to be deleted. [ 790.626918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.627196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.629683] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.644347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.644532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.663157] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.663401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.663506] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.663823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.664103] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.664347] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.665379] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.665554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.665554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.665819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.665934] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.666097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.666097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.666275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.666347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.666412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.666499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.666611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.666693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.666758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.666937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.667052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.667052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.667201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.667253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.667351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.667420] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.668536] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.668737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.668830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.669696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.669696] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.669696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.669696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.669696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.669696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.669696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.670080] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.670080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.670080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.670233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.670292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.670361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.670406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.670550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.670708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.670844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.670906] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.674347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.674501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.674570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.675622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.675622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.675622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.675622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.675622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.675622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.675622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.676140] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.676140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.676140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.676140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.676140] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.676396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.676396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.676595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.676903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.676903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.676903] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.683763] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 384c91ff-3865-47c2-b54a-ade5d4bb5f41: rpc.has_security_group_logging(os_id): False [ 790.743199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.743335] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d is going to be deleted. [ 790.744331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.744561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.744654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.744758] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be deleted. [ 790.745649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.745844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.756454] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.756629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.806743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.806852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.845097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.845270] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 769f17ed-cec0-4733-bb67-f90cba106a02 is going to be deleted. [ 790.846394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.846618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.898343] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.898343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.958161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.958292] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f796b38-dca5-4730-a81c-cd9714b3ab8d is going to be deleted. [ 790.959311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.959531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.042186] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.042340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.055183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.055316] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be deleted. [ 791.056346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.056568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.072194] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.072378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.132987] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4849bc3-c5eb-4d2a-b87d-61a1b4e18236: rpc.has_security_group_logging(os_id): False [ 791.147466] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.147951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.166348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.166348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.172862] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82: rpc.has_security_group_logging(os_id): False [ 791.174457] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c31855b-36a6-4c63-86d7-83465075aed8: rpc.has_security_group_logging(os_id): False [ 791.179122] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf0f4a4-4808-4a1d-a832-54c26e813f60: rpc.has_security_group_logging(os_id): False [ 791.195961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.196148] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be deleted. [ 791.198826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.199526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.242655] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.242655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.243213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.243326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.244398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.244548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.251717] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.251800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.321980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.322156] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2dca75-cd86-462e-b41c-7286490b3384 is going to be deleted. [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.324625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f87a553-f0af-4b3c-a4c8-027ffa03572b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.325022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.325150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.325259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.325378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c5cc4f2-b09e-4802-8402-1b312af39573" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.325514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.325659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.325732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4952419-31e9-43c3-93de-73b6983584c2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.328215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.366876] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.366876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.375255] env[65660]: INFO networking_nsxv3.common.synchronization [req-dbd2e3f2-033b-4a27-a26c-0b4cc68c485a req-79550a35-e75d-4319-bc49-631dfd8c317f service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 791.375255] env[65660]: INFO networking_nsxv3.common.synchronization [req-dbd2e3f2-033b-4a27-a26c-0b4cc68c485a req-79550a35-e75d-4319-bc49-631dfd8c317f service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 791.375255] env[65660]: INFO networking_nsxv3.common.synchronization [req-dbd2e3f2-033b-4a27-a26c-0b4cc68c485a req-79550a35-e75d-4319-bc49-631dfd8c317f service nova] Enqueued Resource ID: c292d803-5d82-4499-a914-146f089c5cd7 with Priority: HIGHEST for action port [ 791.375764] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 791.376449] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 791.376449] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c292d803-5d82-4499-a914-146f089c5cd7 with Priority: HIGHEST for action port [ 791.378119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.378119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.378119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.378119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.378119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c292d803-5d82-4499-a914-146f089c5cd7 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.378119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.378119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.378119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.378119] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c292d803-5d82-4499-a914-146f089c5cd7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.426973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.427386] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.427533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.427585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.427785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.427871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.427969] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 is going to be updated. [ 791.429356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.429538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.429625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.429745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c9e0656-5fea-404b-bf7f-6b1310cebf25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.429874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.430029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.430106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.430223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f0605a5-c443-4058-aec5-d5357dce9d2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.430366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.430508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.430581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.430726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2d9ad21-46f4-448c-8fe4-1c4b61b1c93d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-769f17ed-cec0-4733-bb67-f90cba106a02" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.432324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.432952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.432952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.432952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f796b38-dca5-4730-a81c-cd9714b3ab8d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.433047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.433716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.433716] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.436383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.436383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.492753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.493298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.548009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.548185] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.548283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.548390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.548800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.548954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.549733] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.549733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.549733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.549733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.549733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.550090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.550090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.550178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.550359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.550453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.550554] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be updated. [ 791.552038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.552038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.596558] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.596768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.613018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.613350] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.613507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.613597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.613845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.613951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.614182] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.614332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.614396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.614553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.614635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.614835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.614918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.614979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.615129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.615203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.615295] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 791.616394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.616581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.616666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.616786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.616917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.617067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.675327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.675702] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.675865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.675936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.676171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.676258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.676461] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.676558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.676618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.676835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.676933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.677153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.677237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.677299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.677441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.677516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.677612] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 791.678744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.678944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.710674] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.710926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.772417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.772661] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.772772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.772852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.773086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.773226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.773305] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 is going to be updated. [ 791.774688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.775021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.775184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.775366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.775476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.775648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.775734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.775832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2dca75-cd86-462e-b41c-7286490b3384" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.776101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.776274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.776403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.842472] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: IN_PROGRESS for 2s [ 791.881861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c292d803-5d82-4499-a914-146f089c5cd7 with status ACTIVE [ 791.881861] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.881861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.881861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.881861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.882242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.882242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.882333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.882333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.883029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.883029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.883029] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.883029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.883029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.883308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.883308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.883308] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c292d803-5d82-4499-a914-146f089c5cd7 is going to be updated. [ 791.893252] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.893432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.893481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.893677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.893974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.908362] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.908565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.908565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.908793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.908942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.932075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.932286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.932336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.932556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.932794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.932979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c292d803-5d82-4499-a914-146f089c5cd7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.934163] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.934324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.934394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.934595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.934758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.936069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.936191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.956714] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 791.960550] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 791.976105] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 792.028215] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 792.028945] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.029271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.029372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.029641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.031094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.108158] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: IN_PROGRESS for 2s [ 792.258317] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 792.258317] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.258317] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.258317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.259307] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.763470] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.266587] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.769858] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.770394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.770394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.770394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.770509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.770620] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 793.803009] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.803009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.803009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.803009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.803425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.813242] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 793.858611] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: SUCCESS [ 793.858994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.975975] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 793.976238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.978061] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 793.978264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.988873] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 793.989606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.122243] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: SUCCESS [ 794.122466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.826392] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826392] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.329798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.330131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.330131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.330305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.330555] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.330668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.330715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.330856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.330944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.331044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.331349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.331467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.331701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.331882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.332232] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.332345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.332398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.332540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.332618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.332752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.332870] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.377411] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 796.377817] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 796.835652] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 335a6866-6ca7-4c63-a411-59c67e151de0: rpc.has_security_group_logging(os_id): False [ 796.857243] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.857595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.857664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.857878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.857961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.858173] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.858273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.858332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.858484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.858554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.858736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.859037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.859104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.859248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.859315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.859533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.859591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.859646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.859783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.859851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.859929] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be created. [ 796.923248] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.923487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.923487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.923708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.923902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.943095] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 798.961815] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 798.962216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.378968] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 801.379262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 801.462138] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f11d2412-6309-48df-99a8-909d30b7f016 None None] Enqueued Resource ID: 58cc695d-267b-4a70-b49d-b2f2312509e2 with Priority: HIGHEST for action port [ 801.463929] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58cc695d-267b-4a70-b49d-b2f2312509e2 with Priority: HIGHEST for action port [ 801.464336] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-58cc695d-267b-4a70-b49d-b2f2312509e2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.464470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58cc695d-267b-4a70-b49d-b2f2312509e2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.464617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58cc695d-267b-4a70-b49d-b2f2312509e2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.465899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58cc695d-267b-4a70-b49d-b2f2312509e2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.465899] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58cc695d-267b-4a70-b49d-b2f2312509e2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.971144] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58cc695d-267b-4a70-b49d-b2f2312509e2 [ 801.971402] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.971497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.971563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.971801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.971884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.972138] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58cc695d-267b-4a70-b49d-b2f2312509e2 already deleted. [ 801.972304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58cc695d-267b-4a70-b49d-b2f2312509e2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.495150] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6e874715-7f40-47b1-a7b3-9bf6297ee3a1 tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_rules [ 803.495783] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_rules [ 803.496045] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.496183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.496241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.496488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.496569] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.588130] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ba5a40ce-41fd-4233-974d-93f2f5905d37 tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_rules [ 803.589195] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_rules [ 803.589195] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.589195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.025694] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.025694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.025694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.025694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.025694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.025694] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e already deleted. [ 804.025694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.025694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.026161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.026161] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.549124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.549523] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.549523] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.549523] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.549632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.549841] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e already deleted. [ 804.549841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.775284] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6db0c030-13c4-4e8a-a221-b6eeccd4328d None None] Enqueued Resource ID: 2efa55d8-8010-4ff9-8559-7567425f9887 with Priority: HIGHEST for action port [ 806.775284] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efa55d8-8010-4ff9-8559-7567425f9887 with Priority: HIGHEST for action port [ 806.775649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2efa55d8-8010-4ff9-8559-7567425f9887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.775649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2efa55d8-8010-4ff9-8559-7567425f9887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.775649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2efa55d8-8010-4ff9-8559-7567425f9887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.775892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2efa55d8-8010-4ff9-8559-7567425f9887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.776010] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2efa55d8-8010-4ff9-8559-7567425f9887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.279470] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2efa55d8-8010-4ff9-8559-7567425f9887 [ 807.279781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.279944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.280026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.280306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.280399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.280497] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2efa55d8-8010-4ff9-8559-7567425f9887 already deleted. [ 807.280585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2efa55d8-8010-4ff9-8559-7567425f9887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.252220] env[65660]: INFO networking_nsxv3.common.synchronization [None req-62eabd61-c5d3-43f5-b66e-0e6c4b4de9bc None None] Enqueued Resource ID: a9f97471-ab9b-473f-8b6e-aedcc2789b86 with Priority: HIGHEST for action port [ 809.252880] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f97471-ab9b-473f-8b6e-aedcc2789b86 with Priority: HIGHEST for action port [ 809.254913] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9f97471-ab9b-473f-8b6e-aedcc2789b86 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.255317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9f97471-ab9b-473f-8b6e-aedcc2789b86" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.255734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9f97471-ab9b-473f-8b6e-aedcc2789b86" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.255899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9f97471-ab9b-473f-8b6e-aedcc2789b86" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.256034] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f97471-ab9b-473f-8b6e-aedcc2789b86',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.425037] env[65660]: INFO networking_nsxv3.common.synchronization [None req-11179921-1d12-48c6-845e-a9e2c69aeed6 None None] Enqueued Resource ID: 87d3c9ad-fffb-417a-98d2-5e0de9ecda9a with Priority: HIGHEST for action port [ 809.425685] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87d3c9ad-fffb-417a-98d2-5e0de9ecda9a with Priority: HIGHEST for action port [ 809.426019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-87d3c9ad-fffb-417a-98d2-5e0de9ecda9a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.426150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87d3c9ad-fffb-417a-98d2-5e0de9ecda9a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.426210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87d3c9ad-fffb-417a-98d2-5e0de9ecda9a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.426479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87d3c9ad-fffb-417a-98d2-5e0de9ecda9a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.426574] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87d3c9ad-fffb-417a-98d2-5e0de9ecda9a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.759175] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9f97471-ab9b-473f-8b6e-aedcc2789b86 [ 809.759570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.759774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.759869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.760104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.760190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.760286] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9f97471-ab9b-473f-8b6e-aedcc2789b86 already deleted. [ 809.760843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9f97471-ab9b-473f-8b6e-aedcc2789b86" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.931812] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87d3c9ad-fffb-417a-98d2-5e0de9ecda9a [ 809.931812] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.931812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.931812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.931812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.931812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.931812] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87d3c9ad-fffb-417a-98d2-5e0de9ecda9a already deleted. [ 809.931812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87d3c9ad-fffb-417a-98d2-5e0de9ecda9a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.981937] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c5a9c83f-5611-4bc5-b5b6-a87b57a1090e None None] Enqueued Resource ID: 38829ac0-0bb1-4211-8330-c46e614de417 with Priority: HIGHEST for action port [ 811.985279] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38829ac0-0bb1-4211-8330-c46e614de417 with Priority: HIGHEST for action port [ 811.987150] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-38829ac0-0bb1-4211-8330-c46e614de417 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.989276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38829ac0-0bb1-4211-8330-c46e614de417" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.989276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38829ac0-0bb1-4211-8330-c46e614de417" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.989276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38829ac0-0bb1-4211-8330-c46e614de417" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.989276] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38829ac0-0bb1-4211-8330-c46e614de417',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.492236] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38829ac0-0bb1-4211-8330-c46e614de417 [ 812.492478] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.492617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.492684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.492953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.493054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.493129] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38829ac0-0bb1-4211-8330-c46e614de417 already deleted. [ 812.493212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38829ac0-0bb1-4211-8330-c46e614de417" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.426637] env[65660]: INFO networking_nsxv3.common.synchronization [req-2e4ff28c-4fea-46a1-bc18-55507921438f req-d2825d07-3f6f-403f-88bb-f0e8a2e309f3 tempest-ListImageFiltersTestJSON-2125792351 tempest-ListImageFiltersTestJSON-2125792351-project-member] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 813.426637] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 813.427019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.427697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.427788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.428012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.428522] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.428522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.428522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.428701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.428701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.428701] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.931901] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.214903] env[65660]: INFO networking_nsxv3.common.synchronization [req-8153b4e2-b4d1-47fa-b88f-8d5ed868c932 req-7c0cb1a5-3d29-4f39-b3f8-ed71c350352a tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 814.219019] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 814.219019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.219019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.219019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.219019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.307808] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2e0b1bab-226d-4b71-938e-aadb7a99be00 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_rules [ 814.308395] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_rules [ 814.308756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.308828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.308878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.311266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.311493] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.424108] env[65660]: INFO networking_nsxv3.common.synchronization [None req-0333efbc-3be9-455c-a573-5ee213bc7b4f tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_rules [ 814.424901] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_rules [ 814.424901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.424901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.433648] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.690289] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.690555] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.691074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.691429] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.692268] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.692541] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.692736] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.693232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.693423] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.694334] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.694513] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.694681] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.694958] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.695177] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.695527] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.695757] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.719487] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.719608] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.719717] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.719919] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.720351] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.720618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.720729] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.721150] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.721331] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd8671e4-2b05-4d31-a8b3-5ab7330e81da',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.722451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.722604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.722688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.722924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.723039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.723384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.723384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.723516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.723632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.723727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.723836] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be deleted. [ 814.774495] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.774495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.774495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.774788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.774891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833281] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.833410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.833466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.833676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.833764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833878] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 already deleted. [ 814.834300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.834300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.834300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.834496] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.938123] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.938123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.938123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.938123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.938123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.938123] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be updated. [ 814.983897] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.984152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.984215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.984450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.984644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.003268] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 815.226380] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.226604] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.226734] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.227030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.227186] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.227336] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port cd8671e4-2b05-4d31-a8b3-5ab7330e81da not found, creating... [ 815.227602] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.227752] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.227864] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.228102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.228238] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.228511] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.228683] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.228770] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.228974] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.229116] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.229256] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: cd8671e4-2b05-4d31-a8b3-5ab7330e81da is going to be created. [ 815.253877] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.254210] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.254210] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.254448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.255127] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.255127] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.370804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.371318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.371318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.371318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.371507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.371507] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 already deleted. [ 815.371581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.644162] env[65660]: INFO networking_nsxv3.common.synchronization [req-7375fc3d-158d-4453-9ec3-dd0fa77ee9e3 req-f5ed1b92-5fc5-40db-9aea-836ce7a38b22 tempest-ServersWithSpecificFlavorTestJSON-1002304921 tempest-ServersWithSpecificFlavorTestJSON-1002304921-project-member] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 815.644524] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 815.645074] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.645218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.645286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.645469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.645636] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.645726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.646163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.646163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.646163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.646163] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.006635] env[65660]: INFO networking_nsxv3.common.synchronization [req-8153b4e2-b4d1-47fa-b88f-8d5ed868c932 req-255698c0-6f65-4367-9031-0769e28144e3 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 816.006762] env[65660]: INFO networking_nsxv3.common.synchronization [req-8153b4e2-b4d1-47fa-b88f-8d5ed868c932 req-255698c0-6f65-4367-9031-0769e28144e3 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 816.006947] env[65660]: INFO networking_nsxv3.common.synchronization [req-8153b4e2-b4d1-47fa-b88f-8d5ed868c932 req-255698c0-6f65-4367-9031-0769e28144e3 service nova] Enqueued Resource ID: cd8671e4-2b05-4d31-a8b3-5ab7330e81da with Priority: HIGHEST for action port [ 816.007583] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 816.007663] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 816.007741] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8671e4-2b05-4d31-a8b3-5ab7330e81da with Priority: HIGHEST for action port [ 816.008790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.008887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.009660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.010568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.011310] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.012356] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.014100] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.014100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.014100] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.014386] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.014437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.014918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.014918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.014918] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd8671e4-2b05-4d31-a8b3-5ab7330e81da',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.148992] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.149337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.149482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.149805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.174672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.175065] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.175214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.175306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.176059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.176059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.176059] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be updated. [ 816.207114] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.207308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.208153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.208153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.208153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.217980] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: IN_PROGRESS for 2s [ 816.516674] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.516865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.516955] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.517971] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd8671e4-2b05-4d31-a8b3-5ab7330e81da with status ACTIVE [ 816.518171] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.518566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.518566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.518566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.519059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.519059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.519059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.519059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.519314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.519314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.519581] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.519731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.519800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.519932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.520018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.520463] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd8671e4-2b05-4d31-a8b3-5ab7330e81da is going to be updated. [ 816.546617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.546811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.546874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.547041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.547184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.547342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd8671e4-2b05-4d31-a8b3-5ab7330e81da" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.014918] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 817.015300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.022701] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.528605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.528797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.528853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.529105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.529209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.529309] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be created. [ 817.557994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.558229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.558229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.558476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.558864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.570964] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: UNINITIALIZED for 2s [ 818.228092] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 818.228414] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 deletion is rescheduled due to dependency. [ 818.228414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.583608] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 819.584101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.584172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.584702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.584702] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.584957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.584957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.585114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.585271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.585332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.585436] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.089436] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.089436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.089436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.089436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.089436] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.089436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.089436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.089436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.090177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.090177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.090177] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.090177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.090177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.090177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.090691] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.090691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.090691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.090858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.090914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.091557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.091713] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.596747] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e872372-e4f2-43b5-922d-ee045d8baf5b: rpc.has_security_group_logging(os_id): False [ 820.617092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.617092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.617092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.617092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.617092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.617092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.617092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.617092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.617658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.617730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.617969] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.618138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.618284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.618619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.618717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.618972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.619112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.619180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.619358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.619458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.619593] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be created. [ 820.698754] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.698754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.698754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.698754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.699044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.714964] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 820.834593] env[65660]: INFO networking_nsxv3.common.synchronization [req-fbc81c37-a766-415c-ac1a-e74e5fb7a153 req-3f550c76-573d-44a3-a142-bf4af1e7048d tempest-ListServerFiltersTestJSON-1195138828 tempest-ListServerFiltersTestJSON-1195138828-project-member] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 820.835263] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 820.835670] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.835740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.835781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.837011] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.837322] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.837449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.837510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.837695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.837789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.837895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.157182] env[65660]: INFO networking_nsxv3.common.synchronization [req-77216ed4-396d-40ec-9967-15b94be120d4 req-d3524082-12e1-43e6-9006-a86ad75974b3 tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 821.157182] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 821.157182] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.157182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.157182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.157182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.157182] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.157708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.157919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.158201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.158394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.158583] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.340623] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.664845] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.843313] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.169125] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.347598] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.347598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.347598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.348345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.350735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350735] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 822.379933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.379933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.380202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.380703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.380906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.391722] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 822.671293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.671689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.671689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.671789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.671897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.671955] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 822.756998] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 822.761331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.763541] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.763753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.763857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.764195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.764395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.776439] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 824.402526] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 824.402526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.787527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 824.787849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.873853] env[65660]: INFO networking_nsxv3.common.synchronization [req-6609d96d-52e9-47fa-a804-9f87f82719fd req-a7ee6833-a02a-4c83-b8c4-dacf05efea36 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 825.874486] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 825.874837] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.875195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.875299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.875591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.875780] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.875896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.875990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.876191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.876286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.876480] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.235898] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.236130] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.236256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.236566] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.237216] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.237216] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.237216] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.237432] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.237731] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.237942] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.238070] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.238177] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.238408] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.238525] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.238629] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.238757] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.261349] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.261349] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.261349] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.261349] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.261349] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.261349] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.261349] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.261891] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.262073] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f899ae1-034f-4c4e-a21a-d03e06d58ea7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.380022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.380022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.380022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.380022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.380022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.380022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.380022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.380022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.380480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.380480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.380480] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 already deleted. [ 826.380480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.765723] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.765954] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.766068] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.766351] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.766495] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.766644] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 5f899ae1-034f-4c4e-a21a-d03e06d58ea7 not found, creating... [ 826.766899] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.767066] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.767182] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.767397] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.767609] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.767879] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.768030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.768223] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.768342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.768471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.768603] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 5f899ae1-034f-4c4e-a21a-d03e06d58ea7 is going to be created. [ 826.791334] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.791662] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.791860] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.792223] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.792601] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.793014] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.179622] env[65660]: INFO networking_nsxv3.common.synchronization [req-bc5a6b4d-6949-47b5-adb9-00fbb1552bca req-8b5d4f92-2288-4ad0-b6c5-ca660c5ec82f tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 827.179933] env[65660]: INFO networking_nsxv3.common.synchronization [req-bc5a6b4d-6949-47b5-adb9-00fbb1552bca req-8b5d4f92-2288-4ad0-b6c5-ca660c5ec82f tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_members [ 827.179933] env[65660]: INFO networking_nsxv3.common.synchronization [req-bc5a6b4d-6949-47b5-adb9-00fbb1552bca req-8b5d4f92-2288-4ad0-b6c5-ca660c5ec82f tempest-SecurityGroupsTestJSON-412437979 tempest-SecurityGroupsTestJSON-412437979-project-member] Enqueued Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 827.180454] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGHEST for action security_group_members [ 827.180588] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGHEST for action security_group_members [ 827.180685] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e with Priority: HIGHEST for action security_group_members [ 827.180980] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.181123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.181188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.181382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.181533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.181628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.181690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.181849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.181926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.182024] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.182862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.183014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.183014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.183185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.183320] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.183416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.183476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.183676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.183736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.183780] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.184660] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a92ae96e-10c4-4e29-8e7f-609600f2de2e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.184783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.184783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.184885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.185344] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.185344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.185344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.185344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.185513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.185513] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a92ae96e-10c4-4e29-8e7f-609600f2de2e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.500605] env[65660]: INFO networking_nsxv3.common.synchronization [req-6609d96d-52e9-47fa-a804-9f87f82719fd req-3d841efe-0942-4d75-898b-cafd03729e2c service nova] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 827.500844] env[65660]: INFO networking_nsxv3.common.synchronization [req-6609d96d-52e9-47fa-a804-9f87f82719fd req-3d841efe-0942-4d75-898b-cafd03729e2c service nova] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 827.501046] env[65660]: INFO networking_nsxv3.common.synchronization [req-6609d96d-52e9-47fa-a804-9f87f82719fd req-3d841efe-0942-4d75-898b-cafd03729e2c service nova] Enqueued Resource ID: 5f899ae1-034f-4c4e-a21a-d03e06d58ea7 with Priority: HIGHEST for action port [ 827.501578] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 827.501755] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 827.501799] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f899ae1-034f-4c4e-a21a-d03e06d58ea7 with Priority: HIGHEST for action port [ 827.502101] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.502205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.502272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.502470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.502550] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.505525] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.505525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.505525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.508879] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.508879] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.508879] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.508879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.508879] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f899ae1-034f-4c4e-a21a-d03e06d58ea7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.687966] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.688217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.688323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.688558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.688644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.688845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.688944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.689015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.689170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.689246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.689333] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be updated. [ 827.690881] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.691043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.691114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.691264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.691408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.691523] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.691616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.691668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.691809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.691881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.691962] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 is going to be updated. [ 827.692991] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.693116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.693181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.693325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.717021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.717345] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.717462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.717569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.717930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.717930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.717930] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e is going to be updated. [ 827.735168] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.735346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.735779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.737640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.737756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.737815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.737991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.738127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.749589] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: IN_PROGRESS for 2s [ 827.750282] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: IN_PROGRESS for 2s [ 827.771326] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.771326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.771509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.771602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.771723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.793645] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: IN_PROGRESS for 2s [ 828.011627] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.011794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.011912] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.012936] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f899ae1-034f-4c4e-a21a-d03e06d58ea7 with status ACTIVE [ 828.013133] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.013248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.013313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.013573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.013639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.013816] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.015058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.015058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.015058] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f899ae1-034f-4c4e-a21a-d03e06d58ea7 is going to be updated. [ 828.039489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.039637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.039709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.039924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.040074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.040242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f899ae1-034f-4c4e-a21a-d03e06d58ea7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.517118] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.646041] env[65660]: INFO networking_nsxv3.common.synchronization [req-aa00c504-3954-4154-bd9b-8da8661b91c5 req-ba6d56a0-d379-46c1-bc4c-5b766b08f075 tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 828.646600] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 828.646964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.647103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.647170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.647422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.647572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.647666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.647726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.647863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.647946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.648055] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.988621] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.988760] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.988870] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.989233] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.989493] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.989649] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.989762] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.989968] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.990143] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.990320] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.990424] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.991051] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.991051] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.991051] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.991241] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.991241] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.012981] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.012981] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.012981] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.012981] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.012981] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-77e4fda2-54b7-4147-8c8b-d47eb07b8226 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.013363] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.013363] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.013648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.013820] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e4fda2-54b7-4147-8c8b-d47eb07b8226',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.021561] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.022022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.022022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.022022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.022379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.022379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be created. [ 829.048022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.048197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.048245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.048446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.048615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.059442] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: UNINITIALIZED for 2s [ 829.151695] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.151840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.151970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.152282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.152937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.152937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.152937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.152937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.152937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.153200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.153200] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d already deleted. [ 829.153200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.519745] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.520169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.520169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.520419] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.521029] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.521029] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 77e4fda2-54b7-4147-8c8b-d47eb07b8226 not found, creating... [ 829.521029] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.521241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.521338] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.521540] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.521675] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.521953] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.522118] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.522232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.522434] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.522565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.522734] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 77e4fda2-54b7-4147-8c8b-d47eb07b8226 is going to be created. [ 829.545358] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.545571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.545692] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.545981] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.546437] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.546554] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.764836] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 in Status: SUCCESS [ 829.764964] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 deletion is rescheduled due to dependency. [ 829.765107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.765854] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c31855b-36a6-4c63-86d7-83465075aed8 in Status: SUCCESS [ 829.766019] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 deletion is rescheduled due to dependency. [ 829.766126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.804891] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e in Status: SUCCESS [ 829.805073] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a92ae96e-10c4-4e29-8e7f-609600f2de2e deletion is rescheduled due to dependency. [ 829.805139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a92ae96e-10c4-4e29-8e7f-609600f2de2e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.289055] env[65660]: INFO networking_nsxv3.common.synchronization [req-aa00c504-3954-4154-bd9b-8da8661b91c5 req-b19c9617-1f17-46dd-9273-f875bc5f0b75 service nova] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 830.289257] env[65660]: INFO networking_nsxv3.common.synchronization [req-aa00c504-3954-4154-bd9b-8da8661b91c5 req-b19c9617-1f17-46dd-9273-f875bc5f0b75 service nova] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 830.289395] env[65660]: INFO networking_nsxv3.common.synchronization [req-aa00c504-3954-4154-bd9b-8da8661b91c5 req-b19c9617-1f17-46dd-9273-f875bc5f0b75 service nova] Enqueued Resource ID: 77e4fda2-54b7-4147-8c8b-d47eb07b8226 with Priority: HIGHEST for action port [ 830.289990] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 830.290151] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 830.290294] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e4fda2-54b7-4147-8c8b-d47eb07b8226 with Priority: HIGHEST for action port [ 830.290530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.290653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.290711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.290915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.291032] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.291981] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.292112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.292178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.292359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.292509] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.292636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.292674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.292799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.292884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.293024] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.294423] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e4fda2-54b7-4147-8c8b-d47eb07b8226 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.294533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.294594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.296488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.296488] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e4fda2-54b7-4147-8c8b-d47eb07b8226',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.796565] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.796936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.796936] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.797753] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77e4fda2-54b7-4147-8c8b-d47eb07b8226 with status ACTIVE [ 830.797931] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.801350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.801461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.801682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.801966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.801966] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.802109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.802146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.802307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.802404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.802575] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.802667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.802725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.802863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.802959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.803100] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77e4fda2-54b7-4147-8c8b-d47eb07b8226 is going to be updated. [ 830.826725] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.827424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.827424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.827424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.827424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.827616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e4fda2-54b7-4147-8c8b-d47eb07b8226" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.072719] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 831.072719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.072978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.073190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.073383] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.073595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.073595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.073710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.073781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.073864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.073966] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.147016] env[65660]: INFO networking_nsxv3.common.synchronization [None req-68773896-22a3-4fec-bb0c-2f2239c13cf9 tempest-MigrationsAdminTest-1938599151 tempest-MigrationsAdminTest-1938599151-project-member] Enqueued Resource ID: 28b54f81-660a-47d3-aa2d-08a5db06943b with Priority: HIGHEST for action security_group_rules [ 831.147674] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b54f81-660a-47d3-aa2d-08a5db06943b with Priority: HIGHEST for action security_group_rules [ 831.148834] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b54f81-660a-47d3-aa2d-08a5db06943b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.148834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.148834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.148834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.148834] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b54f81-660a-47d3-aa2d-08a5db06943b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.230376] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f694197d-90d9-4dd9-b6fb-4f9e59b93449 tempest-MigrationsAdminTest-1938599151 tempest-MigrationsAdminTest-1938599151-project-member] Enqueued Resource ID: 28b54f81-660a-47d3-aa2d-08a5db06943b with Priority: HIGHEST for action security_group_rules [ 831.230769] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b54f81-660a-47d3-aa2d-08a5db06943b with Priority: HIGHEST for action security_group_rules [ 831.231190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b54f81-660a-47d3-aa2d-08a5db06943b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.232034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.305473] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.576055] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.676020] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.676020] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b54f81-660a-47d3-aa2d-08a5db06943b already deleted. [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.676020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.676020] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b54f81-660a-47d3-aa2d-08a5db06943b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.808062] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.808415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.808415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.808504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.808584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.808688] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be created. [ 831.835889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.836095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.836207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.836368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.836519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.848208] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: UNINITIALIZED for 2s [ 832.078264] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2604d13b-747f-46b6-934c-17fb07504709: rpc.has_security_group_logging(os_id): False [ 832.099366] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.099613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.099744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.099975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.100114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.100363] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.100488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.100551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.100726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.100813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.100924] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be created. [ 832.164456] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.164624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.164740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.164960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.165168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.183040] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 832.196162] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.196331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.196374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.196595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.196691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.196788] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b54f81-660a-47d3-aa2d-08a5db06943b already deleted. [ 832.196869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b54f81-660a-47d3-aa2d-08a5db06943b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.858950] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 833.859306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.859543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.860124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.860470] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.861077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.861077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.861195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.861302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.861906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.861906] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.161621] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-a19b02ce-0bc3-4e2c-83b4-9d5f8324276d tempest-ListServersNegativeTestJSON-1297675418 tempest-ListServersNegativeTestJSON-1297675418-project-member] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 834.162410] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 834.162817] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.163012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.163118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.163387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.164403] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.164403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.164403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.164403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.164403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.164403] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.198514] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 834.198844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.366071] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.489021] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.489021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.489021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.489665] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.490192] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.490596] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.493019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.493019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.493019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.493019] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.493019] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.493019] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.493019] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.493019] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.493019] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.493019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.515203] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.515299] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.515398] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.515604] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.515982] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-f43bce74-c1b5-4b5a-8fd4-41b52827047a taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.516184] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.516301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.516657] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.516855] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43bce74-c1b5-4b5a-8fd4-41b52827047a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.666435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.666613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.666869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.667178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.667294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.667537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.667651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.667715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.667957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.667957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.668110] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 already deleted. [ 834.668110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.868116] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 225b293b-1569-42d6-87b8-ea54b1fed92d: rpc.has_security_group_logging(os_id): False [ 834.890622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.890798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.891332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.891332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.891592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.891672] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.891847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.891847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.892194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.892194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.892194] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be created. [ 834.961969] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.961969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.961969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.961969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.961969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.988995] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: IN_PROGRESS for 2s [ 835.021411] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.021663] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.021814] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.022132] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.022878] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.022878] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port f43bce74-c1b5-4b5a-8fd4-41b52827047a not found, creating... [ 835.022878] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.023195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.023241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.023460] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.023602] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.024017] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.024241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.024374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.025338] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.025338] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.025338] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: f43bce74-c1b5-4b5a-8fd4-41b52827047a is going to be created. [ 835.053536] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.053536] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.053536] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.053818] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.054099] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.054344] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.798962] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-8d486026-2a35-47af-b9f8-3693338e3512 service nova] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_rules [ 835.799241] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-8d486026-2a35-47af-b9f8-3693338e3512 service nova] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 835.799528] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-8d486026-2a35-47af-b9f8-3693338e3512 service nova] Enqueued Resource ID: f43bce74-c1b5-4b5a-8fd4-41b52827047a with Priority: HIGHEST for action port [ 835.800205] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_rules [ 835.800609] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 835.801176] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43bce74-c1b5-4b5a-8fd4-41b52827047a with Priority: HIGHEST for action port [ 835.801176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.801335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.801335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.801588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.801714] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.802680] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.802844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.803297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.803521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.803717] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.806020] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.806020] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f43bce74-c1b5-4b5a-8fd4-41b52827047a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.806020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.806020] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43bce74-c1b5-4b5a-8fd4-41b52827047a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.309958] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.309958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.309958] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.310385] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f43bce74-c1b5-4b5a-8fd4-41b52827047a with status ACTIVE [ 836.310419] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.310553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.310611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.310782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.311047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.311158] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.311252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.311440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.311440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.311550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.311699] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.311790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.311958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.311958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.312166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.312166] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f43bce74-c1b5-4b5a-8fd4-41b52827047a is going to be updated. [ 836.334490] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.334657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.334720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.334902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.335052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.335215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f43bce74-c1b5-4b5a-8fd4-41b52827047a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.814460] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.864498] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-c30e6ded-7e14-427c-a6e7-b7c068f6278d tempest-ListServersNegativeTestJSON-1297675418 tempest-ListServersNegativeTestJSON-1297675418-project-member] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 836.865066] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 836.865639] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.865742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.000436] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 837.001066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.317767] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.318076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.318076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.318737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.318737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.318737] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be created. [ 837.340509] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.340682] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.341035] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.341092] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.341326] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.341484] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.341598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.341815] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.341957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.342182] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.342291] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.342396] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.342501] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.342606] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.342709] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.342834] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.357169] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.357378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.357378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.357691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.357856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.372033] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.372033] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.372337] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.372337] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.372589] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-8a0c1721-5f6e-44dc-a333-11590b3b691f taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.372775] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.372892] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.373338] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.373481] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a0c1721-5f6e-44dc-a333-11590b3b691f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.379172] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: UNINITIALIZED for 2s [ 837.876619] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.876852] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.877105] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.877360] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.877517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.877708] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 8a0c1721-5f6e-44dc-a333-11590b3b691f not found, creating... [ 837.878140] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.878379] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.878533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.878881] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.879135] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.879513] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.879773] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.879992] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.880393] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.881227] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.881403] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 8a0c1721-5f6e-44dc-a333-11590b3b691f is going to be created. [ 837.904535] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.904829] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.904937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.905281] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.905592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.905866] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.606636] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-ecfa203c-7a1d-4ff7-8480-4b3408de0756 service nova] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_rules [ 838.606999] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-ecfa203c-7a1d-4ff7-8480-4b3408de0756 service nova] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 838.606999] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-ecfa203c-7a1d-4ff7-8480-4b3408de0756 service nova] Enqueued Resource ID: 8a0c1721-5f6e-44dc-a333-11590b3b691f with Priority: HIGHEST for action port [ 838.607523] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_rules [ 838.607666] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 838.607754] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a0c1721-5f6e-44dc-a333-11590b3b691f with Priority: HIGHEST for action port [ 838.608252] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.608391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.608629] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.608731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.608888] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a0c1721-5f6e-44dc-a333-11590b3b691f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.608979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.609061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.609280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.609335] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a0c1721-5f6e-44dc-a333-11590b3b691f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.932507] env[65660]: INFO networking_nsxv3.common.synchronization [req-ea10f022-0301-4502-943e-5ba61281ae4d req-e62594e9-e9b1-4931-ba96-6fe6c575c75a tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 838.932507] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 838.932507] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.932507] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.932507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.932507] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.117023] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a0c1721-5f6e-44dc-a333-11590b3b691f with status ACTIVE [ 839.117023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.117023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.117023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.117023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.117023] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a0c1721-5f6e-44dc-a333-11590b3b691f is going to be updated. [ 839.142032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.142228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.142351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.143044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.143044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.143206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a0c1721-5f6e-44dc-a333-11590b3b691f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.389837] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 839.390063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.390241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.390503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.390705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.390935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.390935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.391096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.391192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.391349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.391384] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.392308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.392481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.392635] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.392737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.392793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.392931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.393059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.393148] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.440568] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.440773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.440773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.441046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.441196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.441353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.441436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.441436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.441609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.441686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.441779] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 839.470800] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.470965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.471067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.471274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.471416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.481905] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 839.851790] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-73208e5e-24b4-4a93-8ebf-5d7fccfc6fb8 tempest-ListServersNegativeTestJSON-1297675418 tempest-ListServersNegativeTestJSON-1297675418-project-member] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 839.852540] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 839.852930] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.853136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.896615] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.897035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.897101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.271033] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.271033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.271033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.271033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.271033] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.271033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.275027] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.275027] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.275027] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.275027] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.275027] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.275027] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.275027] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.275027] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.275027] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.275027] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.303180] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.303363] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.303569] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.303791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-231" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.304478] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-c3909d0e-4146-4378-be2f-007438a78ac0 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.304478] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.304478] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.304990] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.305190] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3909d0e-4146-4378-be2f-007438a78ac0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.400119] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.807986] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.808219] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.808438] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.808625] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.808856] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.809050] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port c3909d0e-4146-4378-be2f-007438a78ac0 not found, creating... [ 840.809334] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.809493] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.809607] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.809833] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.809967] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.810267] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.810421] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.810535] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.810738] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.810869] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.811222] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: c3909d0e-4146-4378-be2f-007438a78ac0 is going to be created. [ 840.836637] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.836841] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.836957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.837281] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.837576] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.837900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.903482] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.903924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.903924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.904175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.904175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.904298] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 840.943817] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.943982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.943982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.944214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.944341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.970267] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 841.493223] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 841.493673] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 841.493673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.579605] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-f952f57f-14a7-48df-88ee-bd69d20eb14a service nova] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_rules [ 841.579885] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-f952f57f-14a7-48df-88ee-bd69d20eb14a service nova] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 841.579956] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4ec45d9-046d-4d73-ba5d-ac8b7aebed4f req-f952f57f-14a7-48df-88ee-bd69d20eb14a service nova] Enqueued Resource ID: c3909d0e-4146-4378-be2f-007438a78ac0 with Priority: HIGHEST for action port [ 841.580496] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_rules [ 841.580741] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 841.580741] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3909d0e-4146-4378-be2f-007438a78ac0 with Priority: HIGHEST for action port [ 841.581075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.581197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.581471] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.581576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.582245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3909d0e-4146-4378-be2f-007438a78ac0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.582245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.582245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.582245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.582245] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3909d0e-4146-4378-be2f-007438a78ac0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.084543] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3909d0e-4146-4378-be2f-007438a78ac0 with status ACTIVE [ 842.084918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.085060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.085855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.085855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.085855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.085855] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.085855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.085855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.086210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.086210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.086410] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.086533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.086606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.086817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.086931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.087054] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3909d0e-4146-4378-be2f-007438a78ac0 is going to be updated. [ 842.113875] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.113875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.113875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.114164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.114278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.114563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3909d0e-4146-4378-be2f-007438a78ac0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.984388] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 842.984682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.984986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.985395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.985630] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.985815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.985869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.986613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.986788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.986904] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.492887] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.995029] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.498029] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.498488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.498662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.498883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.498987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.499138] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 844.536594] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.536953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.537096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.537340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.537492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.548581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 845.073316] env[65660]: INFO networking_nsxv3.common.synchronization [req-a49d8b33-25b9-4d34-b55a-f60910dd7815 req-901d9e20-b8c0-4d50-8326-dbc52ebe39b6 tempest-ServerRescueTestJSON-1602582723 tempest-ServerRescueTestJSON-1602582723-project-member] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 845.073871] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 845.074272] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.074402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.074402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.074975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.074975] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.074975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.074975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.074975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.075303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.075303] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.448890] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.449153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.449311] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.449586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.449839] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.449987] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.450114] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.450319] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.450627] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.450627] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.450763] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.450840] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.450942] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.451097] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.451213] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.451337] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.472059] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.472245] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 845.474653] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.474653] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-218" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.474653] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-3b9df3af-a643-48f5-95c8-a79ed1cf8085 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.474653] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.474653] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.474653] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.474653] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9df3af-a643-48f5-95c8-a79ed1cf8085',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.577519] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.876476] env[65660]: INFO networking_nsxv3.common.synchronization [None req-4f9454a3-f5bd-44b5-8582-1108f01c7a88 None None] Enqueued Resource ID: 642f7ce5-a174-4c95-95a4-3fe2041df667 with Priority: HIGHEST for action port [ 845.877306] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642f7ce5-a174-4c95-95a4-3fe2041df667 with Priority: HIGHEST for action port [ 845.878390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-642f7ce5-a174-4c95-95a4-3fe2041df667 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.878581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-642f7ce5-a174-4c95-95a4-3fe2041df667" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.878661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-642f7ce5-a174-4c95-95a4-3fe2041df667" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.878992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-642f7ce5-a174-4c95-95a4-3fe2041df667" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.879119] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('642f7ce5-a174-4c95-95a4-3fe2041df667',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.977827] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.978269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.979340] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.979340] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.979340] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.979340] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 3b9df3af-a643-48f5-95c8-a79ed1cf8085 not found, creating... [ 845.979868] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.979932] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.980618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.981915] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.982213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.985351] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.985629] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.985817] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.987510] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.987510] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.987510] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 3b9df3af-a643-48f5-95c8-a79ed1cf8085 is going to be created. [ 846.013117] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.013991] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.013991] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.014503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.014898] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.015251] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.080113] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.381238] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 642f7ce5-a174-4c95-95a4-3fe2041df667 [ 846.382367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.382602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.382675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.382887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.383024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.383184] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:642f7ce5-a174-4c95-95a4-3fe2041df667 already deleted. [ 846.383280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-642f7ce5-a174-4c95-95a4-3fe2041df667" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.562806] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 846.563111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.563309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.563532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.564282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.564282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.564282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.564282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.564282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.564282] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.582953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.583319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.583319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.583474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.583570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.583668] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be updated. [ 846.626239] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.626447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.626492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.628018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.628018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.636525] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: IN_PROGRESS for 2s [ 846.801828] env[65660]: INFO networking_nsxv3.common.synchronization [req-a49d8b33-25b9-4d34-b55a-f60910dd7815 req-45ecf45e-17fc-46d2-8293-7f0027c02dea service nova] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_rules [ 846.801828] env[65660]: INFO networking_nsxv3.common.synchronization [req-a49d8b33-25b9-4d34-b55a-f60910dd7815 req-45ecf45e-17fc-46d2-8293-7f0027c02dea service nova] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 846.801828] env[65660]: INFO networking_nsxv3.common.synchronization [req-a49d8b33-25b9-4d34-b55a-f60910dd7815 req-45ecf45e-17fc-46d2-8293-7f0027c02dea service nova] Enqueued Resource ID: 3b9df3af-a643-48f5-95c8-a79ed1cf8085 with Priority: HIGHEST for action port [ 846.802616] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_rules [ 846.802616] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 846.802616] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9df3af-a643-48f5-95c8-a79ed1cf8085 with Priority: HIGHEST for action port [ 846.803345] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.803540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.803682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.804835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.804981] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.807155] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.807155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.807155] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9df3af-a643-48f5-95c8-a79ed1cf8085 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.807155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.807155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.807155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.807155] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9df3af-a643-48f5-95c8-a79ed1cf8085',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.067204] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.312683] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.312683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.312683] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b9df3af-a643-48f5-95c8-a79ed1cf8085 with status ACTIVE [ 847.312941] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.312941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.313718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.313718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.313718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.313718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.313718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.313718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.313985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.313985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.314217] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.314317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.315030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.315030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.315030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.315030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b9df3af-a643-48f5-95c8-a79ed1cf8085 is going to be updated. [ 847.354399] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.354618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.354662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.354903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.355125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.355229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9df3af-a643-48f5-95c8-a79ed1cf8085" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.572426] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.077840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.078754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.078754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.078754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.078754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.078754] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 848.124299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.124527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.124668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.124974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.125225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.140077] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 848.380207] env[65660]: INFO networking_nsxv3.common.synchronization [None req-a19d7410-9cbb-4820-9b5d-2b1892784b8c None None] Enqueued Resource ID: 8da58926-1131-44da-964d-4aab8e60f77b with Priority: HIGHEST for action port [ 848.381657] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da58926-1131-44da-964d-4aab8e60f77b with Priority: HIGHEST for action port [ 848.381657] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-8da58926-1131-44da-964d-4aab8e60f77b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.381657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8da58926-1131-44da-964d-4aab8e60f77b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.381657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8da58926-1131-44da-964d-4aab8e60f77b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.381898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8da58926-1131-44da-964d-4aab8e60f77b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.381898] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8da58926-1131-44da-964d-4aab8e60f77b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.648610] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 848.648610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.648610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.648610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.648778] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.648835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.648894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.649057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.649147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.649336] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.884545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8da58926-1131-44da-964d-4aab8e60f77b [ 848.884828] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.885040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.885157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.885402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.885635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.885779] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8da58926-1131-44da-964d-4aab8e60f77b already deleted. [ 848.885779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8da58926-1131-44da-964d-4aab8e60f77b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.152393] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.654330] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.792124] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-f035aedf-f890-4944-8303-81a55c420d6e tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 849.792124] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 849.792124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.792124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.792124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.792124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.792124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.792124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.792124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.792476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.792476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.792476] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.152884] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 850.152884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.152884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.152884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.152884] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.153350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.153350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.153350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.153350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.153482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.153611] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.153678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.153727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.153920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.153994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.154107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.154164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.154301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.154366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.157348] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.157348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.157348] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.157348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.157348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.158765] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be updated. [ 850.185529] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.185714] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.185838] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.186133] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.186391] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.186571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.186690] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.186924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.189147] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.189147] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.189147] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.189147] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.189300] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.189334] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.189440] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.189573] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.191995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.193315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.193400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.193598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.193745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.209873] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: IN_PROGRESS for 2s [ 850.217154] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.217154] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.217154] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.217154] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.217154] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-349d2335-643b-410f-9b2a-079513d8d368 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.217154] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.217611] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.217611] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.217752] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('349d2335-643b-410f-9b2a-079513d8d368',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.296149] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.296149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.296149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.296336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.317761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.318042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.318171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.318240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.318471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.318561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.318702] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 850.366617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.366781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.366946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.367074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.367251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.379133] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 850.659591] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 762d0913-cb8b-4e75-8dd8-3320e4790403: rpc.has_security_group_logging(os_id): False [ 850.663379] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.678878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.679075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.679075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.679309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.679411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.679611] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.679745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.679831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.680021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.680112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.680282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.680403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.680480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.680569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.680654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.680823] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.680938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.681141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.681216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.681285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.681369] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be created. [ 850.720548] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.720900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.721202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.721600] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.722379] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.722565] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 349d2335-643b-410f-9b2a-079513d8d368 not found, creating... [ 850.722897] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.723147] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.723288] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.723532] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.723695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.724024] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.724190] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.724297] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.724515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.724657] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.724796] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 349d2335-643b-410f-9b2a-079513d8d368 is going to be created. [ 850.742834] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.743050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.743243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.743468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.743652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.753238] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.753558] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.753732] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.754058] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.754352] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.754587] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.756041] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 851.165912] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.480447] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-155adf8c-4388-43af-8887-36f5b2a455f6 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 851.480447] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-155adf8c-4388-43af-8887-36f5b2a455f6 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 851.480447] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-155adf8c-4388-43af-8887-36f5b2a455f6 service nova] Enqueued Resource ID: 349d2335-643b-410f-9b2a-079513d8d368 with Priority: HIGHEST for action port [ 851.480447] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 851.480447] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 851.480447] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349d2335-643b-410f-9b2a-079513d8d368 with Priority: HIGHEST for action port [ 851.480750] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.480750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.480750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.480882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.480917] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.481793] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.481887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.482136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-349d2335-643b-410f-9b2a-079513d8d368 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.482227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.482265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.482461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.482538] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('349d2335-643b-410f-9b2a-079513d8d368',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.668409] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.668584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.668658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.668869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.668959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.669130] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 851.698461] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.698659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.698659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.698838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.698892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.708179] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 851.984614] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.984840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.985605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 349d2335-643b-410f-9b2a-079513d8d368 with status ACTIVE [ 851.985912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.986082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.986236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.986460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.986601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.986808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.986925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.987009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.987218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.987560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.987629] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.987715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.987790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.987972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.988347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.988465] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 349d2335-643b-410f-9b2a-079513d8d368 is going to be updated. [ 852.014134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.014372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.014448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.015453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.015453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.015453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-349d2335-643b-410f-9b2a-079513d8d368" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.222948] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 852.223319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.223471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.223755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.224032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.224172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.224232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.224394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.224470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.224625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.224722] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.389747] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 852.389929] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 deletion is rescheduled due to dependency. [ 852.390056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.390216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.390425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.390596] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.390707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.390767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.390922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.391069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.391183] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.604935] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-0e2ff077-b120-4058-9c0b-c9cf28beb31f tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 852.605555] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 852.605877] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.605982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.730037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.730037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.730037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.730037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.730037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.730720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.730720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.730720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.730720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.730720] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.769033] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 852.769033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.769033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.769298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.769298] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.893146] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.909790] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.909996] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.910140] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.910416] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.910669] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.910823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.910936] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.914494] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.914668] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.914881] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.914995] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.915116] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.915225] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.915332] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.915464] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.915602] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.944589] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.944589] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.944589] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.944589] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-412" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.944589] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-78ee32d3-2ec2-4a08-b1da-131822e7e463 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.945136] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.945136] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.945379] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.945379] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ee32d3-2ec2-4a08-b1da-131822e7e463',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.233337] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa: rpc.has_security_group_logging(os_id): False [ 853.264503] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.264646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.264715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.264931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.272072] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.272248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.334777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.335096] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.335235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.335300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.335553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.335648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.335865] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.335959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.336033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.336206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.336277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.336466] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.336575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.336640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.336761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.336830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.336914] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be updated. [ 853.395080] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.447986] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.448249] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.448376] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.448654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.448801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.448957] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 78ee32d3-2ec2-4a08-b1da-131822e7e463 not found, creating... [ 853.449239] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.449398] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.449509] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.449723] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.449859] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.450153] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.450306] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.450418] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.450620] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.450748] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.450884] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 78ee32d3-2ec2-4a08-b1da-131822e7e463 is going to be created. [ 853.452958] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.453163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.453230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.453402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.453543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.479268] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: IN_PROGRESS for 2s [ 853.481930] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.482299] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.482522] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.482894] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.483342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.483536] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.725840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 853.726112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.726298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.726559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.726830] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.727017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.727155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.727398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.727530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.727680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.727833] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.786763] env[65660]: INFO networking_nsxv3.common.synchronization [req-b73f52aa-be3b-45b2-98b7-569507611f8d req-3345daaf-9fd6-4920-b49b-1904f24de6f1 tempest-ListServersNegativeTestJSON-1297675418 tempest-ListServersNegativeTestJSON-1297675418-project-member] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 853.787418] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 853.787795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.787948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.788210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.789090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.789090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.789090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.789090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.789090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.789090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.789090] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.899011] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.899216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.899282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.899486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.899577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.899675] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 853.940933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.940933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.940933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.940933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.940933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.951248] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 854.230470] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.230851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.243809] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-9efc494e-02a6-43bc-a905-11ea901f08f5 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 854.244543] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-9efc494e-02a6-43bc-a905-11ea901f08f5 service nova] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 854.244543] env[65660]: INFO networking_nsxv3.common.synchronization [req-45127004-dfe3-4260-9ade-b750e3810246 req-9efc494e-02a6-43bc-a905-11ea901f08f5 service nova] Enqueued Resource ID: 78ee32d3-2ec2-4a08-b1da-131822e7e463 with Priority: HIGHEST for action port [ 854.244802] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_rules [ 854.244802] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 854.245210] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee32d3-2ec2-4a08-b1da-131822e7e463 with Priority: HIGHEST for action port [ 854.245210] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.245492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.245492] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.245879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.245879] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-78ee32d3-2ec2-4a08-b1da-131822e7e463 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.245879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.246171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.246171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.246253] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ee32d3-2ec2-4a08-b1da-131822e7e463',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.291594] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.749052] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78ee32d3-2ec2-4a08-b1da-131822e7e463 with status ACTIVE [ 854.749052] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.749052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.749052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.749052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.749343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.749343] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.749426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.749492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.749647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.749721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.749921] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.750048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.750117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.750259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.750332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.750414] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78ee32d3-2ec2-4a08-b1da-131822e7e463 is going to be updated. [ 854.773367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.773567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.773631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.773873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.774029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.774271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78ee32d3-2ec2-4a08-b1da-131822e7e463" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.794990] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.297595] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.297595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.297595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.298124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.298124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.298124] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 855.331736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.331945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.332057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.332304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.332488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.344783] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 855.441253] env[65660]: INFO networking_nsxv3.common.synchronization [req-9d2a9a2e-8ada-4bf3-b8a2-edf70c1f9260 req-57802208-a2d3-47e4-b1f3-a6ab7f6845d8 tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 855.441855] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 855.442272] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.442405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.442466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.442678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.442829] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.444327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.444456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.444589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.444689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.444789] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.495614] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 855.496361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.848809] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.849153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.849325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.850361] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.850787] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.851147] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.851374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.851770] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.852042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.852390] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.852603] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.852825] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.853280] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.853563] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.854490] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.854797] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.882519] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.882807] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.883562] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.883861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-839" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.884348] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-727f4e9d-92ca-4660-b94e-257db21375ff taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.884559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.884682] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.885030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.885171] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('727f4e9d-92ca-4660-b94e-257db21375ff',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.951351] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.951508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.951508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.951730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.951861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.952186] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.952306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.952368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.952541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.952640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.952773] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be deleted. [ 855.970508] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 855.970508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.971113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.971346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.971548] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.971671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.971736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.972678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.972678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.972678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.972678] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.973802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.974201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.974347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.975910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.975910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.975910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.975910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.975910] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.004032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.004032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.004032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.004442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.004527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.004702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.388828] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.389210] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.390051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.390051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.390253] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.390379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 727f4e9d-92ca-4660-b94e-257db21375ff not found, creating... [ 856.390809] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.391717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.391717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.391717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.391907] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.392343] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.392611] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.392811] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.393165] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.393380] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.393630] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 727f4e9d-92ca-4660-b94e-257db21375ff is going to be created. [ 856.434902] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.435169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.435265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.435583] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.436736] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.436736] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.478054] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.478260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.478515] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.980787] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.194216] env[65660]: INFO networking_nsxv3.common.synchronization [req-9d2a9a2e-8ada-4bf3-b8a2-edf70c1f9260 req-a27e47ae-795c-45c5-933e-00f6586fcfa2 service nova] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_rules [ 857.194216] env[65660]: INFO networking_nsxv3.common.synchronization [req-9d2a9a2e-8ada-4bf3-b8a2-edf70c1f9260 req-a27e47ae-795c-45c5-933e-00f6586fcfa2 service nova] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 857.194216] env[65660]: INFO networking_nsxv3.common.synchronization [req-9d2a9a2e-8ada-4bf3-b8a2-edf70c1f9260 req-a27e47ae-795c-45c5-933e-00f6586fcfa2 service nova] Enqueued Resource ID: 727f4e9d-92ca-4660-b94e-257db21375ff with Priority: HIGHEST for action port [ 857.195383] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_rules [ 857.195383] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 857.195549] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 727f4e9d-92ca-4660-b94e-257db21375ff with Priority: HIGHEST for action port [ 857.195830] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.195965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.196066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.196251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.196330] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.197298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.197421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.197488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.197670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.197819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.197911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.197971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.204067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.204067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.204067] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.204067] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-727f4e9d-92ca-4660-b94e-257db21375ff taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.204067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.204067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.204067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.204067] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('727f4e9d-92ca-4660-b94e-257db21375ff',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.353768] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 857.355069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.355069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.355069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.355069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.355069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.355069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.355069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.355410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.355410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.355410] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.355519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.355519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.355624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.355771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.355904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.355973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.356131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.356207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.356289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.356403] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.484452] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.484452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.484452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.484452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.484452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.484452] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 857.516973] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.517138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.517208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.517435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.517671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.529218] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 857.704685] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.705967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.706122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.706304] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 727f4e9d-92ca-4660-b94e-257db21375ff with status ACTIVE [ 857.706501] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.706638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.706708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.706995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.707140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.707337] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.707391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.707489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.707652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.707728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.708186] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.708186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.708186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.708309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.708417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.708481] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 727f4e9d-92ca-4660-b94e-257db21375ff is going to be updated. [ 857.737368] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.737578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.737578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.737720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.737852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.738030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-727f4e9d-92ca-4660-b94e-257db21375ff" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.858515] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 762d0913-cb8b-4e75-8dd8-3320e4790403: rpc.has_security_group_logging(os_id): False [ 857.879539] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.879539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.879701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.879787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.879860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.880099] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.880203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.880259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.880409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.880487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.880663] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.880756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.880822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.880952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.881076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.881217] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.881304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.881358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.881534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.881614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.881700] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 857.980026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.980312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.980312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.980484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.980597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.995603] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 858.211627] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.714281] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.714613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.714613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.714771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.714855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.714954] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be created. [ 858.738160] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.738345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.738416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.738628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.738792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.751030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: UNINITIALIZED for 2s [ 859.542037] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 859.542303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.542491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.542724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.542921] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.543053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.543291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.543468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.543553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.543654] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.011605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 860.011959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.012080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.012238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.012350] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.046035] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.515602] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.515602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.515602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.515602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.515602] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.515602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.515602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.516029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.516115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.517066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.517238] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.548246] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.761694] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 860.761694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.761845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.762309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.762972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.762972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.762972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.762972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.762972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.763281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.763281] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.021765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.022167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.022167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.022167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.022355] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.022445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.022507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.022658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.022725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.022815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.023081] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.023081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.023237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.023292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.023428] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.023555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.023607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.023703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.023778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.023860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.023951] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.052862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.053103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.053103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.053385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.053477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.053586] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 861.101738] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.101871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.101947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.102172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.102326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.111996] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 861.268060] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.268060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.268060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.268373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.268413] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.268620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.268808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.269042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.269144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.269244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.269743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.269743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.269743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.269743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.270035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.270035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.270035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.270264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.270370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.270480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.270596] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.529213] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 762d0913-cb8b-4e75-8dd8-3320e4790403: rpc.has_security_group_logging(os_id): False [ 861.551783] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.551996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.552097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.552311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.552382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.552628] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.552743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.552871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.553136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.553293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.553494] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.553587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.553665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.553803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.554237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.554237] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.554237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.554237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.554468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.554503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.554563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 861.650030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.650030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.650030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.650328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.650328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.667270] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 861.773949] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bb1aae9-5e28-4517-b1d1-0a8a052663cb: rpc.has_security_group_logging(os_id): False [ 861.795804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.795990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.796073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.796246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.796673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.797124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.797243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.797307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.798189] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.798189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.798437] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.798437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.798515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.798614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.799291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.799291] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be created. [ 861.883265] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.883265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.883265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.883265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.883478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.895067] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 862.196506] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 862.196833] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 863.128472] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 863.128472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.128554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.129052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.129052] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.129052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.129216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.129259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.129832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.129832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.129832] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.129832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.129832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.129832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.130109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.130109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.130109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.130222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.130256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.130529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.130674] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.399178] env[65660]: INFO networking_nsxv3.common.synchronization [req-d8129d15-e55b-4ee4-a69d-76c12377ef40 req-c9cf48f3-72d6-49fe-a901-9db21de44b8c tempest-ListImageFiltersTestJSON-2125792351 tempest-ListImageFiltersTestJSON-2125792351-project-member] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 863.399644] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGHEST for action security_group_members [ 863.399693] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.402018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.402018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.402018] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.634702] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6: rpc.has_security_group_logging(os_id): False [ 863.652016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.652175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.652235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.652554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.652647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.652862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.652957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.653044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.653247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.653355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.653530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.653624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.653712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.653873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.654097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.654361] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.654480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.654533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.654647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.654717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.654800] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 863.683469] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 863.683688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.719904] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.719904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.719904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.720434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.720434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.733125] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 863.905319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.905644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.905837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.906221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.906531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.906796] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.907072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.907201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.907474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.907649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.907776] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be updated. [ 863.910633] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 863.910948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.945609] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.945801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.945877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.946124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.946277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.957429] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: IN_PROGRESS for 2s [ 865.157211] env[65660]: INFO networking_nsxv3.common.synchronization [req-ad6275ea-b3c9-406c-8c82-3243fbd05c3e req-d369c6ba-db2b-4da4-a3cb-02c83f259ec5 tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 865.157799] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 865.158175] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.158427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.158534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.158765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.158956] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.159103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.159240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.159397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.159522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.159647] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.274272] env[65660]: INFO networking_nsxv3.common.synchronization [req-a600a026-3ec4-4ee5-bddf-5880f23dac1f req-e847ab4e-5020-453e-bea0-03495392b724 tempest-MultipleCreateTestJSON-1349292612 tempest-MultipleCreateTestJSON-1349292612-project-member] Enqueued Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 865.274797] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 with Priority: HIGHEST for action security_group_members [ 865.275660] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.275660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.662547] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.747078] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 865.747078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.747078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.747273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.747321] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.967398] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 in Status: SUCCESS [ 865.968030] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 deletion is rescheduled due to dependency. [ 865.968030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.164991] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.269460] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.269460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.269649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.269736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.269819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.269896] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be deleted. [ 866.322857] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.323598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.323598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.323598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.323598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.323598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.669274] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.669274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.669274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.669274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.669274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.669274] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be updated. [ 866.695532] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.695532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.695766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.695909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.696718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.706550] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: IN_PROGRESS for 2s [ 868.305460] env[65660]: INFO networking_nsxv3.common.synchronization [req-5c8352c1-3193-4c61-8821-c4a1e7a74797 req-647629e3-f2e7-4532-aa79-fbdacf6bab72 tempest-ImagesOneServerNegativeTestJSON-1650821341 tempest-ImagesOneServerNegativeTestJSON-1650821341-project-member] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 868.305752] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGHEST for action security_group_members [ 868.305959] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.307022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.307022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.307022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.307202] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.307272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.307366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.307660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.307660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.307840] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.718249] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 in Status: SUCCESS [ 868.718508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.718630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.718906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.719113] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.719234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.719301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.719452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.719533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.719628] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b7c0cba-3688-4cc0-935f-a2d962d5bcb6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.809419] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.809604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.809655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.809837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.809923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.810121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.810218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.810318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.810425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.810498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.810581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be updated. [ 868.839055] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.839055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.839257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.839311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.839457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.848915] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: IN_PROGRESS for 2s [ 869.097054] env[65660]: INFO networking_nsxv3.common.synchronization [req-d3649e14-05af-4671-8cf8-046165eb272c req-33f7a9dc-8e61-428e-ae33-df67f834f000 tempest-ServerRescueTestJSON-1602582723 tempest-ServerRescueTestJSON-1602582723-project-member] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 869.097054] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 869.097054] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.097054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.097054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.097054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.097054] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.097054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.097509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.097509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.097509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.097509] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.221644] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.221804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.221869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.222119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.222212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.222422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.222518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.222596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.222727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.222801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.222884] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b7c0cba-3688-4cc0-935f-a2d962d5bcb6 is going to be deleted. [ 869.251059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.251273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.251319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.251573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.251696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.251802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b7c0cba-3688-4cc0-935f-a2d962d5bcb6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.599901] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.102365] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.606309] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.606612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.606612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.606827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.606920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.607027] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be updated. [ 870.644510] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.644510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.644510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.644675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.644830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.654078] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: IN_PROGRESS for 2s [ 870.858212] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb in Status: SUCCESS [ 870.859048] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb deletion is rescheduled due to dependency. [ 870.859048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.361777] env[65660]: INFO networking_nsxv3.common.synchronization [req-ed520c09-6864-41f3-82f0-79548952fce3 req-c5c9d719-13fa-4eaf-9791-e4f96954d11f tempest-ListServerFiltersTestJSON-1195138828 tempest-ListServerFiltersTestJSON-1195138828-project-member] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 872.362359] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGHEST for action security_group_members [ 872.363306] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.363306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.363306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.363306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.363306] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.363306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.363610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.363610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.363610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.363808] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.663943] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 872.664203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.866353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.866445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.866445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.866963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.866963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.866963] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.867190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.867190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.867280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.867391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.867485] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be updated. [ 872.898607] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.898780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.898930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.899035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.899173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.909304] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: IN_PROGRESS for 2s [ 874.920544] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 in Status: SUCCESS [ 874.920816] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 deletion is rescheduled due to dependency. [ 874.920848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.280029] env[65660]: INFO networking_nsxv3.common.synchronization [req-df14022e-08de-4da0-bb53-e91e75c777dc req-15f05ee7-9e0b-4646-b2c5-10ec8e0fccfd tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_members [ 875.280606] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_members [ 875.280930] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.281065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.281132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.281448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.281611] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.281713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.281776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.281928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.282027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.282124] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.292918] env[65660]: INFO networking_nsxv3.common.synchronization [req-b856ad1c-8cd2-4d61-8889-a1ff7593ee01 req-e5d42045-53e9-4a8e-bf4d-1bc9457553fb tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 875.292918] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 875.292918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.293535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.293707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.293983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.294240] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.294591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.294744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.294971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.295148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.295327] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.609815] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.610056] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.610161] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.610434] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.610678] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.610835] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.610952] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.611239] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.611415] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.611623] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.611736] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.612235] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.612235] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.612235] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.612235] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.612375] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.631581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.631757] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.631896] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.632095] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-465" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.632414] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-d3fcb387-c623-4c73-b827-1b75dd267c3f taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.632585] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.632706] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.633083] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.633231] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3fcb387-c623-4c73-b827-1b75dd267c3f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.785113] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.785272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.785272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.785501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.785610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.785843] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.785944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.786018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.786194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.786274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.786358] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e already deleted. [ 875.786458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.799039] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.135304] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.135648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.135648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.135927] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.136093] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.136253] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port d3fcb387-c623-4c73-b827-1b75dd267c3f not found, creating... [ 876.136507] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.136666] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.136784] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.137020] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.137160] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.137437] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.137659] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.137711] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.137897] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.138038] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.138180] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: d3fcb387-c623-4c73-b827-1b75dd267c3f is going to be created. [ 876.160559] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.160559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.160559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.160943] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.161211] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.161447] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.301411] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.805134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.805134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.805134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.805134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.805134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.805134] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 876.836528] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.836701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.836774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.837038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.837178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.846709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 876.866940] env[65660]: INFO networking_nsxv3.common.synchronization [req-df14022e-08de-4da0-bb53-e91e75c777dc req-2d4a8ca3-0cb5-46ad-b4e0-990a93e55d34 service nova] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_rules [ 876.867133] env[65660]: INFO networking_nsxv3.common.synchronization [req-df14022e-08de-4da0-bb53-e91e75c777dc req-2d4a8ca3-0cb5-46ad-b4e0-990a93e55d34 service nova] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_members [ 876.867305] env[65660]: INFO networking_nsxv3.common.synchronization [req-df14022e-08de-4da0-bb53-e91e75c777dc req-2d4a8ca3-0cb5-46ad-b4e0-990a93e55d34 service nova] Enqueued Resource ID: d3fcb387-c623-4c73-b827-1b75dd267c3f with Priority: HIGHEST for action port [ 876.867846] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_rules [ 876.867976] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_members [ 876.868085] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fcb387-c623-4c73-b827-1b75dd267c3f with Priority: HIGHEST for action port [ 876.868812] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.868905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.868939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.869130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.869214] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.870044] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.870623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.870623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.870623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.870623] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.870623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.870841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.870841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.870900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.870993] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.871746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3fcb387-c623-4c73-b827-1b75dd267c3f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.871851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.871914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.872579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.872579] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3fcb387-c623-4c73-b827-1b75dd267c3f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.374016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.374406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.374483] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.375434] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3fcb387-c623-4c73-b827-1b75dd267c3f with status ACTIVE [ 877.375622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.375739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.375773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.375975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.376074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.376258] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.376343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.376407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.376558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.376634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.376809] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.376902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.376962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.377115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.377188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.377272] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3fcb387-c623-4c73-b827-1b75dd267c3f is going to be updated. [ 877.398975] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.399234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.399234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.399409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.399552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.399711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3fcb387-c623-4c73-b827-1b75dd267c3f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.879142] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.384590] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.384889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.384889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.385030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.385125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.385224] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e is going to be created. [ 878.410084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.410233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.410306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.410518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.410680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.423384] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f07331b-fa4c-4bef-bffd-f4749900380e in Status: UNINITIALIZED for 2s [ 878.860911] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 878.860911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.436049] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f07331b-fa4c-4bef-bffd-f4749900380e in Status: SUCCESS [ 880.436318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.436449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.436668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.436898] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.437048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.437110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.437280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.437359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.437468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.437600] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.935397] env[65660]: INFO networking_nsxv3.common.synchronization [req-093b8da0-a07b-4ae1-8875-99f00cec3954 req-295d3de1-a797-49e8-a32f-673fefb5c8c1 tempest-ServersNegativeTestMultiTenantJSON-274585132 tempest-ServersNegativeTestMultiTenantJSON-274585132-project-member] Enqueued Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_members [ 880.936115] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_members [ 880.936492] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.936645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.936740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.937142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.937353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.937501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.937570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.937755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.937858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.937972] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.940465] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.391021] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.391021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-340" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.391021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-340" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.391021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-340" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.391359] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.391733] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.391998] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.392330] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.392564] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.392856] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.393060] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.393363] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.395019] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.395019] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.395019] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.395019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.421024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.421024] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.421024] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.421024] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-340" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.421024] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-58a1e94e-4d41-4d6f-8808-e2454868850c taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.421024] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.421024] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.421024] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.421024] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a1e94e-4d41-4d6f-8808-e2454868850c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.441310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.441310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.441310] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a105954-38cf-4ea3-9175-f0a7478feadd already deleted. [ 881.441310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.444113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f07331b-fa4c-4bef-bffd-f4749900380e: rpc.has_security_group_logging(os_id): False [ 881.464026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.464026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.464026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.464026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e is going to be created. [ 881.531571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.531767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.531767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.531990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.532184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.545130] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f07331b-fa4c-4bef-bffd-f4749900380e in Status: IN_PROGRESS for 2s [ 881.922918] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5e1afca9-26d7-44c4-8052-f2652c94473f None None] Enqueued Resource ID: f39b6601-3100-4885-a41a-0f14fa3e1af5 with Priority: HIGHEST for action port [ 881.923503] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.923716] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.924105] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.924199] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.924369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.924563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 58a1e94e-4d41-4d6f-8808-e2454868850c not found, creating... [ 881.924843] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.925143] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.925571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.925853] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.926072] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.926394] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.926586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.926727] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.926980] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.927159] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.927342] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 58a1e94e-4d41-4d6f-8808-e2454868850c is going to be created. [ 881.928812] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f39b6601-3100-4885-a41a-0f14fa3e1af5 with Priority: HIGHEST for action port [ 881.929132] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f39b6601-3100-4885-a41a-0f14fa3e1af5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.929270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f39b6601-3100-4885-a41a-0f14fa3e1af5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.929358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f39b6601-3100-4885-a41a-0f14fa3e1af5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.929591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f39b6601-3100-4885-a41a-0f14fa3e1af5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.929700] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f39b6601-3100-4885-a41a-0f14fa3e1af5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.951278] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.952648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.952648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.952648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.952648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.952810] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.434212] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f39b6601-3100-4885-a41a-0f14fa3e1af5 [ 882.434580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.434711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.434777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.436785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.436785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.436785] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f39b6601-3100-4885-a41a-0f14fa3e1af5 already deleted. [ 882.436785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f39b6601-3100-4885-a41a-0f14fa3e1af5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.675417] env[65660]: INFO networking_nsxv3.common.synchronization [req-093b8da0-a07b-4ae1-8875-99f00cec3954 req-4aec97c0-84a6-451e-bc36-4e0d91ff43a7 service nova] Enqueued Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_rules [ 882.675738] env[65660]: INFO networking_nsxv3.common.synchronization [req-093b8da0-a07b-4ae1-8875-99f00cec3954 req-4aec97c0-84a6-451e-bc36-4e0d91ff43a7 service nova] Enqueued Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_members [ 882.676406] env[65660]: INFO networking_nsxv3.common.synchronization [req-093b8da0-a07b-4ae1-8875-99f00cec3954 req-4aec97c0-84a6-451e-bc36-4e0d91ff43a7 service nova] Enqueued Resource ID: 58a1e94e-4d41-4d6f-8808-e2454868850c with Priority: HIGHEST for action port [ 882.676553] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_rules [ 882.676740] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_members [ 882.676863] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a1e94e-4d41-4d6f-8808-e2454868850c with Priority: HIGHEST for action port [ 882.677222] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.677392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.677475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.677791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.677896] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.679213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.681672] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.681672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.681672] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.683456] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-58a1e94e-4d41-4d6f-8808-e2454868850c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.683598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.683684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.683918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.684044] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a1e94e-4d41-4d6f-8808-e2454868850c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.186345] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.188480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.188480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.188480] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58a1e94e-4d41-4d6f-8808-e2454868850c with status ACTIVE [ 883.188480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.188480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.188480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.188480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.188480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.188863] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.188863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.188863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.188863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.188986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.189124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.189216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.189275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.189415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.189493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.189574] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58a1e94e-4d41-4d6f-8808-e2454868850c is going to be updated. [ 883.213805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.213952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.213991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.214213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.214357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.214511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58a1e94e-4d41-4d6f-8808-e2454868850c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.561650] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f07331b-fa4c-4bef-bffd-f4749900380e in Status: SUCCESS [ 883.561892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.692408] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.200700] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.200700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.200700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.200700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.200700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.200700] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a105954-38cf-4ea3-9175-f0a7478feadd is going to be created. [ 884.226860] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.226860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.226860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.226860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.226860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.236433] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: UNINITIALIZED for 2s [ 884.257466] env[65660]: INFO networking_nsxv3.common.synchronization [None req-91571896-b6f4-4862-bd39-2211583f0252 None None] Enqueued Resource ID: be849630-69bb-4f29-8e81-bdbd1a896f3e with Priority: HIGHEST for action port [ 884.257997] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be849630-69bb-4f29-8e81-bdbd1a896f3e with Priority: HIGHEST for action port [ 884.258383] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-be849630-69bb-4f29-8e81-bdbd1a896f3e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.258572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be849630-69bb-4f29-8e81-bdbd1a896f3e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.258688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be849630-69bb-4f29-8e81-bdbd1a896f3e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.258924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be849630-69bb-4f29-8e81-bdbd1a896f3e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.259037] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be849630-69bb-4f29-8e81-bdbd1a896f3e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.761350] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be849630-69bb-4f29-8e81-bdbd1a896f3e [ 884.761639] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.761746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.761859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.762111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.762205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.762303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be849630-69bb-4f29-8e81-bdbd1a896f3e already deleted. [ 884.762384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be849630-69bb-4f29-8e81-bdbd1a896f3e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.706767] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-3a9e0cb2-8afd-463f-ae82-115d45104ac8 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 885.707215] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 885.707526] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.707645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.707709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.707899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.708125] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.708238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.708300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.708448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.708530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.708619] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.991857] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-256c72ed-8ed5-4b0b-841b-b225633ab2be tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 885.992241] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 885.992536] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.992642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.210974] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.211146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.211220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.212267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.212435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.212649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.212753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.213084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.213084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.213084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.213251] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be deleted. [ 886.247746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.247746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.247746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.247746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.248078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.248078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.248078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.248218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.248371] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.248713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.248713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.248713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.248713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.248846] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.250303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: UNINITIALIZED for 4s [ 886.372009] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-874 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.372299] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-874" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.372517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-874" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.372971] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-874" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.373405] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.373612] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.373766] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.374039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.374235] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.374477] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.374671] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.374840] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.374981] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.375148] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.375313] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.375585] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.395390] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.395679] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.395850] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.396077] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-874" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.396426] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-7af86f51-37b1-4ce2-a054-a371a4e58fd4 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.396643] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.396796] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.397153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.397352] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af86f51-37b1-4ce2-a054-a371a4e58fd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.751935] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.752121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.752262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.752513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.752607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.752813] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.752911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.752973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.753136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.753211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.753324] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 already deleted. [ 886.753430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.903068] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.903293] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.903472] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.903744] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.903890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.904053] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 7af86f51-37b1-4ce2-a054-a371a4e58fd4 not found, creating... [ 886.904309] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.904461] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.904577] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.904781] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.904913] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.905203] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.905356] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.905527] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.905778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.905908] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.906055] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 7af86f51-37b1-4ce2-a054-a371a4e58fd4 is going to be created. [ 886.926811] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.927011] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.927153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.927414] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.927640] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.927912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.127203] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-84bd631b-0bce-466b-98ea-21b2fe45abd1 service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 888.127203] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-84bd631b-0bce-466b-98ea-21b2fe45abd1 service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 888.127203] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-84bd631b-0bce-466b-98ea-21b2fe45abd1 service nova] Enqueued Resource ID: 7af86f51-37b1-4ce2-a054-a371a4e58fd4 with Priority: HIGHEST for action port [ 888.127203] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 888.127203] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 888.127203] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af86f51-37b1-4ce2-a054-a371a4e58fd4 with Priority: HIGHEST for action port [ 888.128089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.128319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.128463] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.128752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.128907] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.131041] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.131041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.131041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.131041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.131041] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.131041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.131041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.131449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.131449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.131449] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.133396] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af86f51-37b1-4ce2-a054-a371a4e58fd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.133505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.133576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.133747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.133825] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af86f51-37b1-4ce2-a054-a371a4e58fd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.260456] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: SUCCESS [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.263035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263035] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.397936] env[65660]: INFO networking_nsxv3.common.synchronization [req-a6b0b195-10d3-416d-a598-7ce0e416d327 req-75583bbb-e7da-4100-aa29-6a64b23cd925 tempest-ServersWithSpecificFlavorTestJSON-1002304921 tempest-ServersWithSpecificFlavorTestJSON-1002304921-project-member] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 888.398569] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 888.399021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.399134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.399170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.399380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.400228] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.400228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.400228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.400228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.400228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.400228] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.639021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.639021] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.639021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7af86f51-37b1-4ce2-a054-a371a4e58fd4 with status ACTIVE [ 888.639021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.639021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.639021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.639653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.639653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.639653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.639653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.639653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.639653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7af86f51-37b1-4ce2-a054-a371a4e58fd4 is going to be updated. [ 888.661278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.661426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.661498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.661699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.661837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.662036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af86f51-37b1-4ce2-a054-a371a4e58fd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.713121] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.713331] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.713551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.713749] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.714024] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.715032] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.715032] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.715032] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.715032] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.715032] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.715032] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.715276] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.715276] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.715276] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.715367] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.715493] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.754372] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.754506] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.754640] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.754815] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-376" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.755147] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.755314] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.755435] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.755862] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.756021] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.764690] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.764947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.764947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.765121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.765444] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.765444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.765444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.765599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.765710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.765754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.766202] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.766202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.766202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.766202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.766385] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.766385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.766454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.766525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.766594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.766686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.766977] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.903046] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.903224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.903296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.903570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.903669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.903912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.904071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.904120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.904237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.904316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.904418] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be updated. [ 888.920990] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.921264] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.921403] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.921713] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.922173] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.922173] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.922361] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.922619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.922788] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.923031] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.923159] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.923296] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.923470] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.923604] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.923723] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.923857] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.941299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.941575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.941670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.941898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.942064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.948203] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.948387] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.948525] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.948692] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-554" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.949035] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-51af953a-2a1a-48e7-8ed4-f9e75e224455 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.949207] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.949324] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.949643] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.949783] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51af953a-2a1a-48e7-8ed4-f9e75e224455',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.951869] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: IN_PROGRESS for 2s [ 889.142182] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.258827] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.259070] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.259130] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.259403] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.259552] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.259740] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 not found, creating... [ 889.260034] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.260195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.260311] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.260527] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.260663] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.260942] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.261147] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.261334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.261550] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.261685] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.261823] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 is going to be created. [ 889.268538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a105954-38cf-4ea3-9175-f0a7478feadd: rpc.has_security_group_logging(os_id): False [ 889.283609] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.283825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.283950] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.284266] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.284571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.284949] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.286521] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.286736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.286736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.286881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.286964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.287154] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.287254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.287315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.287457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.287532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.287717] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.287808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.288023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.288174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.288249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.288439] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.288534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.288594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.288731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.288803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.288883] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a105954-38cf-4ea3-9175-f0a7478feadd is going to be created. [ 889.380491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.380679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.380804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.381041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.381231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.397280] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: IN_PROGRESS for 2s [ 889.453488] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.453733] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.453902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.454201] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.454510] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.454681] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 51af953a-2a1a-48e7-8ed4-f9e75e224455 not found, creating... [ 889.455069] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.455320] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.455498] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.455840] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.456054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.456482] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.456739] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.456886] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.457197] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.457377] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.457566] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 51af953a-2a1a-48e7-8ed4-f9e75e224455 is going to be created. [ 889.489401] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.489635] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.489765] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.490053] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.490283] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.490515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.644901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.645121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.645230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.645446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.645710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.645710] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be created. [ 889.673392] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.673668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.673668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.673896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.674097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.685415] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: UNINITIALIZED for 2s [ 889.989482] env[65660]: INFO networking_nsxv3.common.synchronization [req-a6b0b195-10d3-416d-a598-7ce0e416d327 req-b18447be-b030-4638-9d68-dfa41c4e9f0d service nova] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 889.989482] env[65660]: INFO networking_nsxv3.common.synchronization [req-a6b0b195-10d3-416d-a598-7ce0e416d327 req-b18447be-b030-4638-9d68-dfa41c4e9f0d service nova] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 889.989685] env[65660]: INFO networking_nsxv3.common.synchronization [req-a6b0b195-10d3-416d-a598-7ce0e416d327 req-b18447be-b030-4638-9d68-dfa41c4e9f0d service nova] Enqueued Resource ID: 852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 with Priority: HIGHEST for action port [ 889.990116] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_rules [ 889.990255] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 889.990468] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 with Priority: HIGHEST for action port [ 889.990665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.990843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.990843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.991098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.991454] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.995229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.995229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.995229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.995229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.995229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.995229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.995229] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.220924] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-84f502a1-bab9-4eb2-8635-4934b1a8b90f service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 890.221198] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-84f502a1-bab9-4eb2-8635-4934b1a8b90f service nova] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 890.221283] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a61ebff-80ad-4ce0-b182-4a15ebee351e req-84f502a1-bab9-4eb2-8635-4934b1a8b90f service nova] Enqueued Resource ID: 51af953a-2a1a-48e7-8ed4-f9e75e224455 with Priority: HIGHEST for action port [ 890.221552] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_rules [ 890.221627] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 890.221716] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51af953a-2a1a-48e7-8ed4-f9e75e224455 with Priority: HIGHEST for action port [ 890.222267] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.222361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.222554] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.222631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.222843] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-51af953a-2a1a-48e7-8ed4-f9e75e224455 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.222968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.222968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.223442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.223442] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51af953a-2a1a-48e7-8ed4-f9e75e224455',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.495901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.496076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.496304] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 with status ACTIVE [ 890.496483] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.496591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.496661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.496954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.497093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.498058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.498058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.498058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.498058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.498058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.498058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.498444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.498444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.498508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.498897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.498897] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0 is going to be updated. [ 890.523432] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.523432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.523432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.523728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.524648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.524648] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-852cee6b-7e70-4ed8-8dc7-2a38ee0ec0b0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.725494] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51af953a-2a1a-48e7-8ed4-f9e75e224455 with status ACTIVE [ 890.725602] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.725735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.725869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.726044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.726145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.726333] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.726622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.726622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.726730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.726730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.726896] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.726988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.727061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.727232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.727341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.727437] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51af953a-2a1a-48e7-8ed4-f9e75e224455 is going to be updated. [ 890.754149] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.754376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.754432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.754701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.754885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.755109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51af953a-2a1a-48e7-8ed4-f9e75e224455" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.921118] env[65660]: INFO networking_nsxv3.common.synchronization [req-3645ce44-6531-4c2d-9c2b-76e8d8a79ed4 req-4744f3c5-6e6f-4ad5-a9a8-f1a07e0a2c11 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_members [ 890.922949] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_members [ 890.922949] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.922949] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.922949] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.924117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.924117] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.924117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.924117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.924389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.924573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.924780] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.962092] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 890.962092] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 deletion is rescheduled due to dependency. [ 890.962092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.962092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.962344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.962533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.962647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.962712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.962859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.962937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.963046] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.316405] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.316405] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.316405] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.316405] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.316939] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.316939] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.316939] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.317125] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.317172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.317385] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.319071] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.319071] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.319071] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.319071] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.319071] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.319071] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.346109] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.346109] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.346109] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.346109] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.346109] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.346109] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.346503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.346503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.346668] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eb276e3-b3b5-4f32-a83a-a0696deb19a2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.409650] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: SUCCESS [ 891.409890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.427457] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.427616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.427691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.427928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.428048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.428234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.428335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.428399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.428559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.428634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.428720] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 already deleted. [ 891.428861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.465910] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.695995] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 891.696253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.696636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.696819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.696925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.696987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.697155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.697232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.697311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.697414] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.698285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.698439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.698585] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.698678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.698737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.699071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.699071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.699071] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.849383] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.849582] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.849730] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.850163] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.850564] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.850634] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 2eb276e3-b3b5-4f32-a83a-a0696deb19a2 not found, creating... [ 891.851032] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.851284] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.851654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.852475] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.852475] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.852725] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.852834] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.853042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.853362] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.853697] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.853922] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 2eb276e3-b3b5-4f32-a83a-a0696deb19a2 is going to be created. [ 891.876375] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.876472] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.876916] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.877347] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.877694] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.878039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.970459] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.200755] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.200947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.201245] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.473021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.473572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.473572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.473572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.473764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.473764] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be updated. [ 892.504608] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.504728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.504785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.504946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.505100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.513941] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: IN_PROGRESS for 2s [ 892.590185] env[65660]: INFO networking_nsxv3.common.synchronization [req-3645ce44-6531-4c2d-9c2b-76e8d8a79ed4 req-ee7c1c71-fa59-4e4d-b317-c51958c37a57 service nova] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_rules [ 892.590385] env[65660]: INFO networking_nsxv3.common.synchronization [req-3645ce44-6531-4c2d-9c2b-76e8d8a79ed4 req-ee7c1c71-fa59-4e4d-b317-c51958c37a57 service nova] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_members [ 892.590525] env[65660]: INFO networking_nsxv3.common.synchronization [req-3645ce44-6531-4c2d-9c2b-76e8d8a79ed4 req-ee7c1c71-fa59-4e4d-b317-c51958c37a57 service nova] Enqueued Resource ID: 2eb276e3-b3b5-4f32-a83a-a0696deb19a2 with Priority: HIGHEST for action port [ 892.591095] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_rules [ 892.591238] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_members [ 892.591385] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb276e3-b3b5-4f32-a83a-a0696deb19a2 with Priority: HIGHEST for action port [ 892.591612] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.591744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.591799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.591995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.592090] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.592947] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.593077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.593145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.593318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.593531] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.593592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.593637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.593781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.593869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.593959] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.594799] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.594864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.594905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.596880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.597141] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eb276e3-b3b5-4f32-a83a-a0696deb19a2',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.704027] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.100437] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.100594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.100769] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.102031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eb276e3-b3b5-4f32-a83a-a0696deb19a2 with status ACTIVE [ 893.102031] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.102217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.102297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.102505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.102596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.102773] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.102860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.102919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.103092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.103172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.103354] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.103466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.103528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.103673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.103746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.103826] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eb276e3-b3b5-4f32-a83a-a0696deb19a2 is going to be updated. [ 893.127431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.127562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.127664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.127846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.127981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.128153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eb276e3-b3b5-4f32-a83a-a0696deb19a2" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.206152] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.206287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.206287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.206466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.206546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.206659] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 893.252391] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.252391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.252391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.253533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.253533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.263850] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 893.511171] env[65660]: INFO networking_nsxv3.common.synchronization [req-8ccfe507-f96b-4ea4-9b20-89e3dd7f6416 req-6029caf1-5996-4af4-a496-a6cb156789be tempest-ServersNegativeTestMultiTenantJSON-274585132 tempest-ServersNegativeTestMultiTenantJSON-274585132-project-member] Enqueued Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_members [ 893.511412] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGHEST for action security_group_members [ 893.512061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.512061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.512061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.512508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.512747] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.512900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.513009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.513239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.513372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.513531] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.606725] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.737857] env[65660]: INFO networking_nsxv3.common.synchronization [req-d90e05fe-9e80-442a-b747-cf8144f1eab2 req-2a6b15f6-bad9-430e-ba62-4f3b75aaafe6 tempest-ServersAdminNegativeTestJSON-1347068261 tempest-ServersAdminNegativeTestJSON-1347068261-project-member] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 893.738551] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 893.738979] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.739164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.739234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.739495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.739722] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.739819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.739901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.740086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.740203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.740303] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.017099] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.017244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.017283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.017587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.017624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.017821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.017940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.018016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.018208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.018288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.018513] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a105954-38cf-4ea3-9175-f0a7478feadd is going to be updated. [ 894.049728] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.049728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.049728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.049895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.049940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.060432] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: IN_PROGRESS for 2s [ 894.111592] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.111831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.111965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.112253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.112413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.112554] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 is going to be created. [ 894.137821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.137989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.138063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.138389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.138505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.143308] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.143553] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.143678] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.143923] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.144188] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.144338] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.144470] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.144725] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.144902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.145117] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.145228] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.145332] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.145439] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.145597] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.145672] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.145822] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.150114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 in Status: UNINITIALIZED for 2s [ 894.164236] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.164430] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 894.164603] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.164855] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.165240] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.165441] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.165579] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.165928] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.166043] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9edfbe3c-e1ea-4bcf-80f6-862ee1189030',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.243641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.243756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.243756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.243967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.244073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.244286] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.244384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.244468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.245822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.245822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.245822] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e already deleted. [ 894.245822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.525784] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 894.526085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.526209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.526429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.526623] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.526739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.526805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.526952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.527046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.527130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.527221] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.670828] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.670828] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.670828] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.671703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.671703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.671703] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 9edfbe3c-e1ea-4bcf-80f6-862ee1189030 not found, creating... [ 894.671703] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.671845] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.672517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.672517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.672517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.672971] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.672971] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.672971] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.674933] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.674933] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.674933] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 9edfbe3c-e1ea-4bcf-80f6-862ee1189030 is going to be created. [ 894.696388] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.696629] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.696778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.697075] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.697676] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.697676] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.029676] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.275843] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 4s [ 895.423698] env[65660]: INFO networking_nsxv3.common.synchronization [req-d90e05fe-9e80-442a-b747-cf8144f1eab2 req-5b9fbed3-b32d-4358-bf4a-13a7be1720e9 service nova] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_rules [ 895.423934] env[65660]: INFO networking_nsxv3.common.synchronization [req-d90e05fe-9e80-442a-b747-cf8144f1eab2 req-5b9fbed3-b32d-4358-bf4a-13a7be1720e9 service nova] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 895.424092] env[65660]: INFO networking_nsxv3.common.synchronization [req-d90e05fe-9e80-442a-b747-cf8144f1eab2 req-5b9fbed3-b32d-4358-bf4a-13a7be1720e9 service nova] Enqueued Resource ID: 9edfbe3c-e1ea-4bcf-80f6-862ee1189030 with Priority: HIGHEST for action port [ 895.424793] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_rules [ 895.424793] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 895.424907] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9edfbe3c-e1ea-4bcf-80f6-862ee1189030 with Priority: HIGHEST for action port [ 895.425185] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.425305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.425370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.425749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.425844] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.427472] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.427591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.427657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.427832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.428012] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.428125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.428185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.428337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.428421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.428506] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.429279] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.429396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.429462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.429614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.429687] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9edfbe3c-e1ea-4bcf-80f6-862ee1189030',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.531840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db90b51b-f35c-42cc-8ed2-59a87f10bd43: rpc.has_security_group_logging(os_id): False [ 895.550708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.550942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.551066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.551375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.551500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.551912] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.552154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.552154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.552364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.552364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.552474] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be updated. [ 895.611068] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.611338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.611418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.611622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.611767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.627653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: IN_PROGRESS for 2s [ 895.928500] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.928704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.931098] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.934858] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9edfbe3c-e1ea-4bcf-80f6-862ee1189030 with status ACTIVE [ 895.935622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.935622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.935622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.935622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.935798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.935948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.936106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.936179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.936386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.936501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.936747] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.936880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.936959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.937178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.937267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.937376] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9edfbe3c-e1ea-4bcf-80f6-862ee1189030 is going to be updated. [ 895.961234] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.961451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.961560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.961815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.962144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.962217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9edfbe3c-e1ea-4bcf-80f6-862ee1189030" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.071698] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a105954-38cf-4ea3-9175-f0a7478feadd in Status: SUCCESS [ 896.071888] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a105954-38cf-4ea3-9175-f0a7478feadd deletion is rescheduled due to dependency. [ 896.072019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.162806] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 in Status: SUCCESS [ 896.163019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.163321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.163613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.163918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.163918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.164077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.164162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.164242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.164326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.164462] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.433719] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.666513] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.936405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.936564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.936634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.936852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.936941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.937051] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be created. [ 896.961558] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.962982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.962982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.962982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.962982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.972622] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: UNINITIALIZED for 2s [ 897.168607] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cad2f7bd-5440-41f4-8c8a-0a54a291c118: rpc.has_security_group_logging(os_id): False [ 897.190158] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.190312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.190490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.190588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.190675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.190918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.191026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.191089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.191240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.191437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.191536] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 is going to be created. [ 897.263773] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.263950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.263988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.264290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.264545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.279763] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 in Status: IN_PROGRESS for 2s [ 897.287782] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.289953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.289953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.289953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.290475] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.290475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.290606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.290695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.290770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.290855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.290976] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.644042] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 897.644042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.793896] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5: rpc.has_security_group_logging(os_id): False [ 897.819050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.819050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.819050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.819050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.819468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.819468] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.820571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.820571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.820873] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.821194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.821380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.821744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.821937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.822279] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.822279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.822437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.822638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.822792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.822955] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be created. [ 897.929221] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.929600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.930853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.930853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.930853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.977777] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 898.984195] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 898.984518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.984708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.984990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.985243] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.985420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.985531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.985763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.985874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.986025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.986162] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.291338] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 in Status: SUCCESS [ 899.291338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.488387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.488666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.488796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.489141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.489436] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.489612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.489725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.489929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.490036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.490152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.490319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.490415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.490494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.490658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.490804] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.490907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.491034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.491350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.491552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.491692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.491969] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.994849] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 899.995153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.995363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.995620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.995733] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.997295] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 527845fc-1b66-4f17-85ee-b1fc80f19f8e: rpc.has_security_group_logging(os_id): False [ 900.018658] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.018788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.018845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.019063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.019157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.019342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.019440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.019537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.019649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.019724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.019902] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.019994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.020831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.020831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.020831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.020831] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.020831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.020831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.021035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.021035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.021087] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be created. [ 900.081840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.081999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.082062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.082257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.082432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.095349] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: IN_PROGRESS for 2s [ 900.425994] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 900.426301] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 900.501967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.502248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.502953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.502953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.502953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.502953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.503124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.503217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.503338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.503486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.503835] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.006215] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.006215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.007850] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.007850] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.007850] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.007850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.008408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.008408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.008539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.008584] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.510780] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5: rpc.has_security_group_logging(os_id): False [ 901.536497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.536497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.536497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.536497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.537221] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.537221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.537221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.537221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.537221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.537221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 901.607491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.607694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.608362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.608362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.608362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.626583] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 901.988219] env[65660]: INFO networking_nsxv3.common.synchronization [req-cf43363d-48d8-4b9e-920e-6958b4a32c91 req-58a8168d-c042-46b3-839e-e785aa14b00b tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 901.988595] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 901.988989] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.989179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.989304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.989599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.989801] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.989909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.989996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.990268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.990268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.990390] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.114240] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 902.114240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.422970] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.423367] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.423367] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.423620] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.423890] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.424052] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.425206] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.425206] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.425206] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.425206] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.425206] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.425206] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.425206] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.425426] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.425426] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.425486] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.448291] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.448463] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.448606] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.448760] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.449119] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-125e8e38-75da-4e7a-a752-045af38a9a26 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.449296] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.449416] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.449751] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.449893] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('125e8e38-75da-4e7a-a752-045af38a9a26',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.492917] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.880099] env[65660]: INFO networking_nsxv3.common.synchronization [req-2274b3d8-726e-42bd-a544-0335c52abc6c req-9b8f744b-e3c0-4246-8e1a-a943d5947f40 tempest-ListServersNegativeTestJSON-1297675418 tempest-ListServersNegativeTestJSON-1297675418-project-member] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 902.880971] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 902.881412] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.881617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.881667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.881945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.882192] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.882358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.882457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.882695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.882833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.882973] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.952831] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.952960] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.953078] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.953371] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.953636] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.953811] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 125e8e38-75da-4e7a-a752-045af38a9a26 not found, creating... [ 902.954025] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.954357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.954408] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.954667] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.954826] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.955330] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.955330] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.955519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.955567] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.955701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.955841] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 125e8e38-75da-4e7a-a752-045af38a9a26 is going to be created. [ 902.982332] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.982539] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.982637] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.982912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.983166] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.984169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.999473] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.266871] env[65660]: INFO networking_nsxv3.common.synchronization [req-15f265bb-2ffa-474a-9a0c-486e36b0ab94 req-53c99484-5bf7-4f49-a813-c580754d6b29 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 903.267451] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 903.267819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.267934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.267934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.268318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.268497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.268602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.268663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.268823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.268910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.269015] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.386202] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.502294] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.502461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.502534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.502763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.502854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.502953] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 903.536050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.536201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.536273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.536487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.536662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.541671] env[65660]: INFO networking_nsxv3.common.synchronization [req-15f265bb-2ffa-474a-9a0c-486e36b0ab94 req-4708bc72-1223-41fc-9c1d-1248a01789c3 tempest-ServersTestMultiNic-2124620363 tempest-ServersTestMultiNic-2124620363-project-member] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 903.542211] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGHEST for action security_group_members [ 903.542523] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.542622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.546114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 903.644782] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 903.645058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.693230] env[65660]: INFO networking_nsxv3.common.synchronization [req-cf43363d-48d8-4b9e-920e-6958b4a32c91 req-c67f244e-1b27-476d-841a-73d50ceeaa0c service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 903.693406] env[65660]: INFO networking_nsxv3.common.synchronization [req-cf43363d-48d8-4b9e-920e-6958b4a32c91 req-c67f244e-1b27-476d-841a-73d50ceeaa0c service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 903.693560] env[65660]: INFO networking_nsxv3.common.synchronization [req-cf43363d-48d8-4b9e-920e-6958b4a32c91 req-c67f244e-1b27-476d-841a-73d50ceeaa0c service nova] Enqueued Resource ID: 125e8e38-75da-4e7a-a752-045af38a9a26 with Priority: HIGHEST for action port [ 903.693793] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 903.693918] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 903.694018] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 125e8e38-75da-4e7a-a752-045af38a9a26 with Priority: HIGHEST for action port [ 903.694747] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.694894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.694927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.695146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.695242] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.696011] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.696129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.696290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-125e8e38-75da-4e7a-a752-045af38a9a26 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.696386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.696450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.696595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.696669] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('125e8e38-75da-4e7a-a752-045af38a9a26',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.752983] env[65660]: INFO networking_nsxv3.common.synchronization [req-f57c2609-8a0b-4a11-9e6a-543ac52e956d req-b513ed2e-4c69-4ab3-bf5c-e08b1c1220fe tempest-ListServersNegativeTestJSON-1297675418 tempest-ListServersNegativeTestJSON-1297675418-project-member] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 903.753559] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGHEST for action security_group_members [ 903.753878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.753982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.771767] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.890210] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.198546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.198725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.198956] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 125e8e38-75da-4e7a-a752-045af38a9a26 with status ACTIVE [ 904.199214] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.199359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.199464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.199696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.199772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.199943] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.200048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.200112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.200280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.200347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.200509] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.200599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.200657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.200793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.200884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.200964] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 125e8e38-75da-4e7a-a752-045af38a9a26 is going to be updated. [ 904.226675] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.226828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.226894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.227118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.227410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.227410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-125e8e38-75da-4e7a-a752-045af38a9a26" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.275142] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.393155] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.393155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.393434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.393517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.393636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.393740] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 904.435302] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.435553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.435553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.435709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.435881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.444616] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 904.606748] env[65660]: INFO networking_nsxv3.common.synchronization [req-e00ef8c7-ca1f-4dbd-aa7d-d2d6a0f4d186 req-dbe8b95d-e296-484e-a0fd-06c037895c62 tempest-MigrationsAdminTest-1938599151 tempest-MigrationsAdminTest-1938599151-project-member] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 904.608907] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 904.609347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.609435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.609557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.609739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.612020] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.612020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.612020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.612020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.612020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.612020] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.777548] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.777716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.777780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.778010] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.778104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.778201] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 904.806054] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.806054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.806054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.806254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.807034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.815565] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 904.925445] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.925668] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.925790] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.926056] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.927519] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.927756] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.927863] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.928102] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.928244] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.928443] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.928551] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.928656] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.928759] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.928862] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.928963] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.929101] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.948328] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.948492] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.948625] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.948789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.949103] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.949273] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.949391] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.950107] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.950107] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6cc16c4-a82d-4ec6-8e5e-e462176d3f49',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.114209] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.452589] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.452945] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.453151] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.453462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.453654] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.453817] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 not found, creating... [ 905.454204] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.454409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.454573] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.454869] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.455063] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.455456] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.455666] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.455804] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.456106] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.456270] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.456426] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 is going to be created. [ 905.479974] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.479974] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.479974] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.480308] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.480598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.480917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.558861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 905.558979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.559428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.560118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.560118] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.560118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.560118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.561190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.561291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.561400] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.616717] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.064591] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.119391] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.119711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.119783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.120130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.120263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.120401] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be updated. [ 906.165422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.165689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.165754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.166092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.166336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.180988] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: IN_PROGRESS for 2s [ 906.314832] env[65660]: INFO networking_nsxv3.common.synchronization [req-e00ef8c7-ca1f-4dbd-aa7d-d2d6a0f4d186 req-1d445827-7fed-40fc-8852-2cc4a2e08ddb service nova] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_rules [ 906.314947] env[65660]: INFO networking_nsxv3.common.synchronization [req-e00ef8c7-ca1f-4dbd-aa7d-d2d6a0f4d186 req-1d445827-7fed-40fc-8852-2cc4a2e08ddb service nova] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 906.315067] env[65660]: INFO networking_nsxv3.common.synchronization [req-e00ef8c7-ca1f-4dbd-aa7d-d2d6a0f4d186 req-1d445827-7fed-40fc-8852-2cc4a2e08ddb service nova] Enqueued Resource ID: c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 with Priority: HIGHEST for action port [ 906.315601] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_rules [ 906.315738] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 906.315870] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 with Priority: HIGHEST for action port [ 906.316250] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.316339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.316386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.316576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.316696] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.318044] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.318153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.318349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.318455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.318521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.318720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.318803] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6cc16c4-a82d-4ec6-8e5e-e462176d3f49',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.457114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 906.457440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.458048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.458334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.458584] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.458774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.458847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.459023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.459111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.459211] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.568419] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.821282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.821282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.821807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 with status ACTIVE [ 906.821807] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.821807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.822093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.822165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.822298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.822535] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.822689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.822768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.822972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.823095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.823694] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.823892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.823962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.824494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.824653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.824653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6cc16c4-a82d-4ec6-8e5e-e462176d3f49 is going to be updated. [ 906.826548] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 906.826758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.826918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.827174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.827373] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.827483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.827542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.827700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.827832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.827887] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.853564] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.853948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.853948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.854194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.854194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.854336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6cc16c4-a82d-4ec6-8e5e-e462176d3f49" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.962343] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.962484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.962581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.962775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.962870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.963113] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.963233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.963913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.963913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.963913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.963913] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be updated. [ 907.007138] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.007138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.007566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.007566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.008429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.019229] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: IN_PROGRESS for 2s [ 907.071550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.072346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.072526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.072872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.073019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.073186] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 907.116024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.116024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.116024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.116024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.116024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.128994] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 907.330517] env[65660]: INFO networking_nsxv3.common.synchronization [req-7b45d2be-06d9-4bbd-88f5-eb5c46b9648a req-b32287bc-09ae-4ab2-81d9-1dfad4d7257a tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 907.331421] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.331421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.331421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.331688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.331688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.331798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.331905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.332024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.332264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.332372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.332462] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be updated. [ 907.334904] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 907.334904] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335536] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.336015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.336057] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.388025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.388291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.388401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.388720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.388962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.400985] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: IN_PROGRESS for 2s [ 907.730688] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.730997] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.731054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.731436] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.731797] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.731991] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.732169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.732469] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.732917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.733286] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.733428] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.733712] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.733872] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.734295] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.734295] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.734295] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.760290] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.760290] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.760290] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.760290] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.760507] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-b927d7b8-336f-4acb-b88f-f7ccfd23291a taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.760649] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.760798] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.761111] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.761222] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b927d7b8-336f-4acb-b88f-f7ccfd23291a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.838743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.839078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.839078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.839794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.839794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.839794] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.839794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.839972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.840137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.840196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.840269] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 907.879114] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.879638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.879875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.880312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.881027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.900940] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 908.190329] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 908.190555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.190724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.190955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.191156] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.191272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.191336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.191684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.191780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.191890] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.264509] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.264753] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.264998] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.265488] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.265751] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.265993] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port b927d7b8-336f-4acb-b88f-f7ccfd23291a not found, creating... [ 908.266394] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.266676] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.266870] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.267222] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.267445] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.267845] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.268069] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.268343] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.268623] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.268823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.269052] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: b927d7b8-336f-4acb-b88f-f7ccfd23291a is going to be created. [ 908.305323] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.305666] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.305762] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.306205] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.306497] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.306767] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.694177] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.033413] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 in Status: SUCCESS [ 909.033413] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 deletion is rescheduled due to dependency. [ 909.033839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.044559] env[65660]: INFO networking_nsxv3.common.synchronization [req-7b45d2be-06d9-4bbd-88f5-eb5c46b9648a req-f59b9008-b41d-4e87-9426-2cd155cd7e54 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 909.044559] env[65660]: INFO networking_nsxv3.common.synchronization [req-7b45d2be-06d9-4bbd-88f5-eb5c46b9648a req-f59b9008-b41d-4e87-9426-2cd155cd7e54 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 909.044559] env[65660]: INFO networking_nsxv3.common.synchronization [req-7b45d2be-06d9-4bbd-88f5-eb5c46b9648a req-f59b9008-b41d-4e87-9426-2cd155cd7e54 service nova] Enqueued Resource ID: b927d7b8-336f-4acb-b88f-f7ccfd23291a with Priority: HIGHEST for action port [ 909.044981] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 909.045146] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 909.045192] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b927d7b8-336f-4acb-b88f-f7ccfd23291a with Priority: HIGHEST for action port [ 909.045471] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.045574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.045640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.045844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.045923] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.048320] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.048448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.048695] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b927d7b8-336f-4acb-b88f-f7ccfd23291a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.048809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.048875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.049070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.049150] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b927d7b8-336f-4acb-b88f-f7ccfd23291a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.142064] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 909.142064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.142064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.142064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.142334] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.142402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.142498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.142706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.142782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.142866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.142955] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.197162] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.411127] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 in Status: SUCCESS [ 909.411404] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 deletion is rescheduled due to dependency. [ 909.411477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.453332] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb78ef8a-5874-4d19-9d3c-e65bafb7064f req-bfdd2cd7-4dbe-4898-8fb1-720e2cdf11b8 tempest-ServersTestFqdnHostnames-1596316355 tempest-ServersTestFqdnHostnames-1596316355-project-member] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_members [ 909.454182] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGHEST for action security_group_members [ 909.454544] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.455870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.455870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.455870] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.555026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b927d7b8-336f-4acb-b88f-f7ccfd23291a with status ACTIVE [ 909.555026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.555026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.555026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.555026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.555026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b927d7b8-336f-4acb-b88f-f7ccfd23291a is going to be updated. [ 909.556599] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.556964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.582546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.582546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.582546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.582546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.582546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.582546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b927d7b8-336f-4acb-b88f-f7ccfd23291a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.644995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.645156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.645156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.645339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.645514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.645627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.645683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.645907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.645983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.646180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.646229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.646319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.646374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.646500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.646652] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.646723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.646851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.646925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.646975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.647079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.647157] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.701236] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.701366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.701366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.701759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.701908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.702308] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be updated. [ 909.741967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.741967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.741967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.741967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.741967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.754464] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: IN_PROGRESS for 2s [ 909.914054] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 909.914243] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 909.914360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.914554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.914796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.914982] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.915112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.915178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.915325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.915406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.915501] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.958107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.958288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.958381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.958666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.958780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.959058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.959177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.959293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.959480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.959561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.959647] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 is going to be updated. [ 909.989136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.989290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.989361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.989603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.989746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.999198] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: IN_PROGRESS for 2s [ 910.151399] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 335a6866-6ca7-4c63-a411-59c67e151de0: rpc.has_security_group_logging(os_id): False [ 910.173013] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.173589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.173589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.173735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.173735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.174071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.174168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.174998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.174998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.174998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.174998] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.175186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.175259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.175488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.175576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.177258] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.181022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.181100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.181303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.181404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.181500] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 910.239351] env[65660]: INFO networking_nsxv3.common.synchronization [req-e42502c6-c684-4713-9d32-b55b51f20687 req-0d96b733-cc27-4a7b-b64d-7fc2f853ed0f tempest-ServersNegativeTestJSON-634766943 tempest-ServersNegativeTestJSON-634766943-project-member] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 910.240017] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 910.240973] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.240973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.240973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.241196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.242404] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.242404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.242538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.242724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.242909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.242909] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.248190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.248190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.248190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.248190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.248190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.266548] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 910.417327] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.728648] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.728840] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.728974] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.729327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.729590] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.729992] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.729992] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.730224] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.730400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.730650] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.730797] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.730931] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.731079] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.731227] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.731364] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.731537] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.751284] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.751448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.751521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.751804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.751902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.752159] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.752273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.752350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.752532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.752620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.752705] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 already deleted. [ 910.752800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.771744] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.771967] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.772132] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.772377] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.772744] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-0cbe4161-3405-42ff-a87d-758637fabede taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.772927] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.773033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.773485] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.773722] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbe4161-3405-42ff-a87d-758637fabede',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.920051] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.277177] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.277553] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.277703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.277912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.278073] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.278234] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 0cbe4161-3405-42ff-a87d-758637fabede not found, creating... [ 911.278507] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.278667] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.278781] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.279025] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.279153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.279498] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.279662] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.279780] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.279996] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.280153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.280294] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 0cbe4161-3405-42ff-a87d-758637fabede is going to be created. [ 911.305449] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.305710] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.305942] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.306421] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.306732] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.307353] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.422797] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.423069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.423069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.423466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.424028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.424028] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 911.465269] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.466231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.466392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.466712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.466918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.484228] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 911.769705] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 911.769705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.769936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.770163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.770366] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.770558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.770558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.770701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.770783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.771364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.771364] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.014120] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 in Status: SUCCESS [ 912.014120] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 deletion is rescheduled due to dependency. [ 912.014120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.053390] env[65660]: INFO networking_nsxv3.common.synchronization [req-e42502c6-c684-4713-9d32-b55b51f20687 req-000e2792-dda6-40d5-8b60-4ac79e681251 service nova] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_rules [ 912.053675] env[65660]: INFO networking_nsxv3.common.synchronization [req-e42502c6-c684-4713-9d32-b55b51f20687 req-000e2792-dda6-40d5-8b60-4ac79e681251 service nova] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 912.053843] env[65660]: INFO networking_nsxv3.common.synchronization [req-e42502c6-c684-4713-9d32-b55b51f20687 req-000e2792-dda6-40d5-8b60-4ac79e681251 service nova] Enqueued Resource ID: 0cbe4161-3405-42ff-a87d-758637fabede with Priority: HIGHEST for action port [ 912.054525] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_rules [ 912.055017] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 912.055158] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cbe4161-3405-42ff-a87d-758637fabede with Priority: HIGHEST for action port [ 912.055559] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.055719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.055833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.056179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.056319] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.058118] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.058118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.058118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.058118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.058354] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.058354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.058354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.058619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.058668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.058971] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.059908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cbe4161-3405-42ff-a87d-758637fabede taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.066056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.066056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.066056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.066056] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbe4161-3405-42ff-a87d-758637fabede',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.273409] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.273714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.273800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.274327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.274550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.274686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.274866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.275090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.275529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.275529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.275529] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.275529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.275834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.275834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.275915] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.275975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.276756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.276756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.276888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.276888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.276964] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.288583] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 912.288989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.567657] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.568725] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.568885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.570411] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cbe4161-3405-42ff-a87d-758637fabede with status ACTIVE [ 912.570767] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.571749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.571861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.572186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.572368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.572642] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.572810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.573028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.573125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.573287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.573624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.574532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.574532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.574532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.574532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.574532] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cbe4161-3405-42ff-a87d-758637fabede is going to be updated. [ 912.600907] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.601092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.601151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.601489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.601653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.601862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.779863] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5075ffdb-26d9-4c45-8f12-db06f5a52322: rpc.has_security_group_logging(os_id): False [ 912.783835] env[65660]: INFO networking_nsxv3.common.synchronization [req-755fdcd6-c382-4b7b-ae54-c5f057c0cc21 req-5841919b-1709-4922-a53a-11906205d688 tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 912.786546] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 912.786546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.786763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.786763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.787371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.787371] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.787499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.787499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.787686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.787851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.787895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.808911] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.808911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.808911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.809243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.844641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.845129] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.845371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.845498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.846347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.846347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.846475] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.846677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.847030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.847131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.847290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.847677] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.847873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.847993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.848286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.848458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.848632] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be updated. [ 912.938394] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.938704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.938704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.938863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.939241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.961099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: IN_PROGRESS for 2s [ 913.070504] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.290852] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.291293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.291293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.291416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.291416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.291634] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.292733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.292733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.292733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.292733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.292733] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 already deleted. [ 913.292733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.467111] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.467314] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.467435] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.467696] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.468015] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.473017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.473017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.473017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.473017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.473017] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.473017] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.473017] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.473017] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.473017] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.473017] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.473017] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.494175] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.494175] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.494175] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.494175] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.494175] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-4b7935b3-a24b-4657-abeb-a3810445ab9d taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.494175] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.494175] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.494791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.494791] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b7935b3-a24b-4657-abeb-a3810445ab9d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.498104] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 913.498700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.499063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.499263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.499597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.499597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.499597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.499757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.499851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.499902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.500148] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.574265] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.574834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.574923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.575142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.575233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.575333] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be created. [ 913.600711] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.600869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.600930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.601166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.601329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.612907] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: UNINITIALIZED for 2s [ 913.745014] env[65660]: INFO networking_nsxv3.common.synchronization [None req-285baee1-904e-43bb-84a9-728a7261da67 None None] Enqueued Resource ID: a2beb22f-32a1-46a5-bc19-5426436f421c with Priority: HIGHEST for action port [ 913.745661] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2beb22f-32a1-46a5-bc19-5426436f421c with Priority: HIGHEST for action port [ 913.745954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2beb22f-32a1-46a5-bc19-5426436f421c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.746083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2beb22f-32a1-46a5-bc19-5426436f421c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.746273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2beb22f-32a1-46a5-bc19-5426436f421c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.746412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2beb22f-32a1-46a5-bc19-5426436f421c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.746531] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2beb22f-32a1-46a5-bc19-5426436f421c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.002517] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.002781] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.002961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.003299] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.003500] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.003744] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 4b7935b3-a24b-4657-abeb-a3810445ab9d not found, creating... [ 914.004088] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.004289] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.004474] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.004768] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.004930] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.005300] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.005507] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.005647] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.005912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.006112] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.006282] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 4b7935b3-a24b-4657-abeb-a3810445ab9d is going to be created. [ 914.007573] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.007675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.007755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.007899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.008053] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.008174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.008273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.008459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.008535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.008618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.008806] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.008899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.008960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.009124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.009259] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.009350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.009409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.009542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.009626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.009705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.009799] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.030730] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.030955] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.031076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.031343] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.031571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.031807] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.247962] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2beb22f-32a1-46a5-bc19-5426436f421c [ 914.248226] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.248366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.248436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.248654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.248749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.248846] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2beb22f-32a1-46a5-bc19-5426436f421c already deleted. [ 914.248928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2beb22f-32a1-46a5-bc19-5426436f421c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.512889] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e872372-e4f2-43b5-922d-ee045d8baf5b: rpc.has_security_group_logging(os_id): False [ 914.536630] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.537150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.537150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.537332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.537479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.538228] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.538228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.538228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.538228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.538537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.538537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.538652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.538697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.538934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.538934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.539162] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.539289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.539324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.539473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.539555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.539640] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 914.600123] env[65660]: INFO networking_nsxv3.common.synchronization [req-964de928-ac25-46de-92f6-ef3e1c47ee18 req-0738f809-9dd9-466a-ab9e-afe489598e11 tempest-ServerRescueTestJSON-1602582723 tempest-ServerRescueTestJSON-1602582723-project-member] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 914.600796] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGHEST for action security_group_members [ 914.601791] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.601921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.602037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.602261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.602460] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.603922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.604035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.604192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.604298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.604361] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.613127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.613452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.613452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.613597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.615546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.636928] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 914.773405] env[65660]: INFO networking_nsxv3.common.synchronization [req-755fdcd6-c382-4b7b-ae54-c5f057c0cc21 req-9639f9a8-4651-41fe-9d1a-e396dd6c6bd2 service nova] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_rules [ 914.773405] env[65660]: INFO networking_nsxv3.common.synchronization [req-755fdcd6-c382-4b7b-ae54-c5f057c0cc21 req-9639f9a8-4651-41fe-9d1a-e396dd6c6bd2 service nova] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 914.773405] env[65660]: INFO networking_nsxv3.common.synchronization [req-755fdcd6-c382-4b7b-ae54-c5f057c0cc21 req-9639f9a8-4651-41fe-9d1a-e396dd6c6bd2 service nova] Enqueued Resource ID: 4b7935b3-a24b-4657-abeb-a3810445ab9d with Priority: HIGHEST for action port [ 914.773405] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_rules [ 914.773405] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 914.773405] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b7935b3-a24b-4657-abeb-a3810445ab9d with Priority: HIGHEST for action port [ 914.776353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.777847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.777847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.777847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.777847] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.779550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.779713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.779818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.780487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.780487] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.780487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.780487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.780809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.782306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.782306] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.782306] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b7935b3-a24b-4657-abeb-a3810445ab9d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.782306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.782739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.783496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.783496] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b7935b3-a24b-4657-abeb-a3810445ab9d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.906171] env[65660]: INFO networking_nsxv3.common.synchronization [req-e8883d0b-0616-4952-abd5-5625a55451ef req-5c00c3cb-73ec-4ac9-b8b2-b4f5d34b67c9 tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 914.907119] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 914.910024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.910024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.910024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.910024] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.984745] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 914.984745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.109941] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.110120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.110515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.110515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.110515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.110932] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.110932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.110932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.111252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.111252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.111252] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be updated. [ 915.148228] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.148438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.148438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.148857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.148857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.160783] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: IN_PROGRESS for 2s [ 915.285571] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.286803] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.286937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.287171] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b7935b3-a24b-4657-abeb-a3810445ab9d with status ACTIVE [ 915.287444] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.287623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.287676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.287884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.287973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.288156] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.288254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.288314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.288528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.288659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.288879] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.288979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.289054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.289201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.289278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.289362] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b7935b3-a24b-4657-abeb-a3810445ab9d is going to be updated. [ 915.319011] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.319176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.319248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.319465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.319668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.319879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b7935b3-a24b-4657-abeb-a3810445ab9d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.413548] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.436373] env[65660]: INFO networking_nsxv3.common.synchronization [req-1579aad4-6003-45c1-b210-3cd06ae3bb34 req-a1fc9bc0-fb46-41ce-b99c-a755462657db tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 915.437586] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 915.437864] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.437993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.438347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.438685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.439095] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.439269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.439539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.439871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.440058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.440511] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.632196] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 915.632911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.632911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.632911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.633222] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.633222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.633222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.633421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.633421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.633493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.633609] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.664635] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f9456d9b-02cd-48eb-9510-2e69ef10f047 tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 915.668812] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 915.670318] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.670462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.670462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.670796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.670897] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.791923] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.917295] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.945808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.946133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.946226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.946481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.946575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.946805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.946920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.946973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.947215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.947334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.947452] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 already deleted. [ 915.947544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.960027] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.960027] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.960202] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.960509] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.960803] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.960961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.961246] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.961513] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.961720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.961955] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.962633] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.962633] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.962633] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.962633] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.962633] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.962916] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.975283] env[65660]: INFO networking_nsxv3.common.synchronization [None req-93684e00-39a3-4535-b8f1-108a42adaebe tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 915.976264] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 915.976628] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.976751] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.988515] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.988704] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.988842] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.989060] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.989398] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-6427d27f-560b-4681-a6f6-1325fd46e43c taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.989572] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.989691] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.990286] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.990475] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6427d27f-560b-4681-a6f6-1325fd46e43c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.135514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.139025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.139025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.139025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139897] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.197107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.197301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.197341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.198022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.198145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.198250] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 already deleted. [ 916.198335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.198494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.198669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.198758] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.294487] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.294717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.295371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.295371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.295371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.295371] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be created. [ 916.328255] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.328623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.328823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.329258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.329450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.347481] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: UNINITIALIZED for 2s [ 916.420540] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.420719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.420810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.421333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.422169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.422169] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 916.458306] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.458500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.458577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.458958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.458958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.471527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 916.492849] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.493228] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.493433] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.493855] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.494112] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.494351] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 6427d27f-560b-4681-a6f6-1325fd46e43c not found, creating... [ 916.494756] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.495010] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.495205] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.495540] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.495758] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.496220] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.496458] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.496668] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.496965] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.497191] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.497402] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 6427d27f-560b-4681-a6f6-1325fd46e43c is going to be created. [ 916.523475] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.523751] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.523879] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.524195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.524511] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.524738] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.596702] env[65660]: INFO networking_nsxv3.common.synchronization [None req-05edcb39-c8ab-4b77-900b-48acde0dde52 None None] Enqueued Resource ID: d7f10e0d-92f3-424d-af73-66c2c1329b0a with Priority: HIGHEST for action port [ 916.597056] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7f10e0d-92f3-424d-af73-66c2c1329b0a with Priority: HIGHEST for action port [ 916.597547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7f10e0d-92f3-424d-af73-66c2c1329b0a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.597547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7f10e0d-92f3-424d-af73-66c2c1329b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.597547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7f10e0d-92f3-424d-af73-66c2c1329b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.601098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7f10e0d-92f3-424d-af73-66c2c1329b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.601401] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7f10e0d-92f3-424d-af73-66c2c1329b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.642116] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3402fe38-bb82-4e23-ab22-23f54a22de87: rpc.has_security_group_logging(os_id): False [ 916.668933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.669082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.669338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.669432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.669432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.669620] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.669743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.669803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.669994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.670106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.670390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.670390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.670510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.670631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.670689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.670843] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.671137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.671137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.671137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.671310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.671310] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be created. [ 916.673968] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 916.674389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.733060] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.733453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.733453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.734105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.734105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.734105] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 already deleted. [ 916.734105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.745726] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.745946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.745946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.746126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.746362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.758908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 917.107012] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7f10e0d-92f3-424d-af73-66c2c1329b0a [ 917.107012] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.107012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.107012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.107012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.107012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.107012] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7f10e0d-92f3-424d-af73-66c2c1329b0a already deleted. [ 917.107012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7f10e0d-92f3-424d-af73-66c2c1329b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.175547] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa in Status: SUCCESS [ 917.176086] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa deletion is rescheduled due to dependency. [ 917.176807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.296820] env[65660]: INFO networking_nsxv3.common.synchronization [req-1579aad4-6003-45c1-b210-3cd06ae3bb34 req-89d762ff-689b-47cb-97db-02a2e54a1570 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 917.296820] env[65660]: INFO networking_nsxv3.common.synchronization [req-1579aad4-6003-45c1-b210-3cd06ae3bb34 req-89d762ff-689b-47cb-97db-02a2e54a1570 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 917.297033] env[65660]: INFO networking_nsxv3.common.synchronization [req-1579aad4-6003-45c1-b210-3cd06ae3bb34 req-89d762ff-689b-47cb-97db-02a2e54a1570 service nova] Enqueued Resource ID: 6427d27f-560b-4681-a6f6-1325fd46e43c with Priority: HIGHEST for action port [ 917.297877] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 917.297877] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 917.297877] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6427d27f-560b-4681-a6f6-1325fd46e43c with Priority: HIGHEST for action port [ 917.297995] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.298512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.298627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.298936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.299080] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.300444] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.300780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.300780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.300948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.301190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.301360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.301472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.301670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.302009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.302342] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.303086] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6427d27f-560b-4681-a6f6-1325fd46e43c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.304053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.304147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.304308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.304836] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6427d27f-560b-4681-a6f6-1325fd46e43c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.805853] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.806185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.806185] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.807452] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6427d27f-560b-4681-a6f6-1325fd46e43c with status ACTIVE [ 917.807928] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.808085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.808166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.808364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.808454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.808681] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.808839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.808839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.808975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.809228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.809491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.809655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.809655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.809805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.809881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.809966] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6427d27f-560b-4681-a6f6-1325fd46e43c is going to be updated. [ 917.835994] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.836224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.836343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.836577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.836748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.837011] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6427d27f-560b-4681-a6f6-1325fd46e43c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.311821] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.361280] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: SUCCESS [ 918.361651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.361870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.362203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.362437] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.362592] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.362678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.362836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.362931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.363034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.363125] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.484366] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 918.484774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.777124] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 918.777478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.816489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.816859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.816859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.817206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.817487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.817487] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be created. [ 918.843858] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.844067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.844067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.845339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.845339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.866597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.866681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.866750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.866984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.867172] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.867276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.867338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.867484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.867569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.867657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.867840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.867971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.868034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.868481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.868719] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.868823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.868883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.870148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.870148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.870148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.870148] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.873119] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: UNINITIALIZED for 2s [ 919.376661] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b604088e-8278-4c35-a94f-fc57fbebf7a4: rpc.has_security_group_logging(os_id): False [ 919.397411] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.397607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.397708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.397932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.397932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.398245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.398245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.398398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.398514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.398514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.398706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.398759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.399145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.399145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.399317] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.399411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.399608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.399728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.399871] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be created. [ 919.462400] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.463188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.463188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.463188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.463331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.477654] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: IN_PROGRESS for 2s [ 920.884521] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 920.885179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.885416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.885647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.885846] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.885994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.886263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.886263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.886412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.886412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.886471] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.389501] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.389697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.389804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.392943] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.392943] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.392943] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.392943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.392943] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.493517] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: SUCCESS [ 921.493882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.895029] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2663bd-4c5a-4280-b2b0-ccd214332642: rpc.has_security_group_logging(os_id): False [ 921.917909] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.918153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.918235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.918496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.918597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.919279] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.919490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.919490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.919700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.919825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.919991] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.920123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.920193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.920365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.920454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.920655] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.920784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.920854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.921034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.921114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.921207] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be created. [ 921.994201] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.994382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.994457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.994713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.994900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.012770] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 922.298974] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 922.299229] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 924.028031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 924.028388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.108191] env[65660]: INFO networking_nsxv3.common.synchronization [None req-405c8a71-4f1c-482f-bbf7-bf1eeb0fe7c0 None None] Enqueued Resource ID: e84e93c5-8f12-4610-a3ca-684293daec4c with Priority: HIGHEST for action port [ 926.108659] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84e93c5-8f12-4610-a3ca-684293daec4c with Priority: HIGHEST for action port [ 926.108982] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e84e93c5-8f12-4610-a3ca-684293daec4c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.109125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e84e93c5-8f12-4610-a3ca-684293daec4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.109191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e84e93c5-8f12-4610-a3ca-684293daec4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.109487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e84e93c5-8f12-4610-a3ca-684293daec4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.109563] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e84e93c5-8f12-4610-a3ca-684293daec4c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.613078] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e84e93c5-8f12-4610-a3ca-684293daec4c [ 926.613513] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.613805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.614092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.614425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.615181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.618324] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e84e93c5-8f12-4610-a3ca-684293daec4c already deleted. [ 926.618899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e84e93c5-8f12-4610-a3ca-684293daec4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.951873] env[65660]: INFO networking_nsxv3.common.synchronization [req-ede8f20d-36b1-42d5-805a-30888d0ef8ba req-6e0cfcbf-b404-4bc5-97bb-673015644d0c tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 926.953364] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 926.953885] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.954043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.954115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.954930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.954930] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.954930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.954930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.954930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.954930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.954930] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.386534] env[65660]: INFO networking_nsxv3.common.synchronization [req-2773b61f-2198-444b-b33a-922a2592957f req-ee5379eb-6b31-45a3-b199-f7b2ba530079 tempest-ServersAdminNegativeTestJSON-1347068261 tempest-ServersAdminNegativeTestJSON-1347068261-project-member] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 927.386534] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 927.386855] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.386855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.386942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.387590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.387792] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.387906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.387962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.388145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.388233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.388324] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.460378] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.768674] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6bcf6d2b-5b17-44d8-97b6-155e9c9390e3 None None] Enqueued Resource ID: 7da7aa31-5938-434d-a080-698377f4e0b3 with Priority: HIGHEST for action port [ 927.769249] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7da7aa31-5938-434d-a080-698377f4e0b3 with Priority: HIGHEST for action port [ 927.769572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7da7aa31-5938-434d-a080-698377f4e0b3 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.769693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7da7aa31-5938-434d-a080-698377f4e0b3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.769761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7da7aa31-5938-434d-a080-698377f4e0b3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.770009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7da7aa31-5938-434d-a080-698377f4e0b3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.773446] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7da7aa31-5938-434d-a080-698377f4e0b3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.890545] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.934877] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.934877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.934877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.934877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.934877] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.935281] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.935520] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.935823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.936081] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.936377] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.936578] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.936775] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.936978] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.939017] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.939017] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.939017] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.964070] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.977568] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.978339] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.978339] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.978339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-410" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.978527] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-68f724e9-fda2-42fc-b4ef-2b342cab4976 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.978663] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.978778] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.979147] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.979279] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f724e9-fda2-42fc-b4ef-2b342cab4976',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.276509] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7da7aa31-5938-434d-a080-698377f4e0b3 [ 928.276856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.277055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.277162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.277449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.277577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.277709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7da7aa31-5938-434d-a080-698377f4e0b3 already deleted. [ 928.277852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7da7aa31-5938-434d-a080-698377f4e0b3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.393706] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.467113] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.467682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.468021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.469164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.470034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.470034] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 928.487373] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.490018] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 68f724e9-fda2-42fc-b4ef-2b342cab4976 not found, creating... [ 928.490018] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.490018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.490592] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.490923] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.491401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.491964] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.492260] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.492533] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 68f724e9-fda2-42fc-b4ef-2b342cab4976 is going to be created. [ 928.506459] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.506661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.507235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.508184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.508184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.521644] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.521644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.521644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.521644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.521644] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.521908] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.523691] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 928.897646] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.897772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.897845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.898023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.898128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.898257] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be updated. [ 928.935343] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.935343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.935343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.935343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.935343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.942978] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: IN_PROGRESS for 2s [ 929.238565] env[65660]: INFO networking_nsxv3.common.synchronization [None req-0a2b34c0-a203-4970-aba9-f2538af781b6 None None] Enqueued Resource ID: a127e711-32a8-4029-9706-258432d92a5a with Priority: HIGHEST for action port [ 929.238565] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a127e711-32a8-4029-9706-258432d92a5a with Priority: HIGHEST for action port [ 929.238565] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a127e711-32a8-4029-9706-258432d92a5a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.238565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a127e711-32a8-4029-9706-258432d92a5a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.239172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a127e711-32a8-4029-9706-258432d92a5a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.240136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a127e711-32a8-4029-9706-258432d92a5a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.240237] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a127e711-32a8-4029-9706-258432d92a5a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.349125] env[65660]: INFO networking_nsxv3.common.synchronization [req-2773b61f-2198-444b-b33a-922a2592957f req-ef039c51-ae5e-45b4-8011-4a76274c433f service nova] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_rules [ 929.349536] env[65660]: INFO networking_nsxv3.common.synchronization [req-2773b61f-2198-444b-b33a-922a2592957f req-ef039c51-ae5e-45b4-8011-4a76274c433f service nova] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 929.349780] env[65660]: INFO networking_nsxv3.common.synchronization [req-2773b61f-2198-444b-b33a-922a2592957f req-ef039c51-ae5e-45b4-8011-4a76274c433f service nova] Enqueued Resource ID: 68f724e9-fda2-42fc-b4ef-2b342cab4976 with Priority: HIGHEST for action port [ 929.350409] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_rules [ 929.351953] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 929.351953] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f724e9-fda2-42fc-b4ef-2b342cab4976 with Priority: HIGHEST for action port [ 929.351953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.351953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.351953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.351953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.351953] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.353185] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.353393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.353691] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f724e9-fda2-42fc-b4ef-2b342cab4976 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.355020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.355280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.355563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.357297] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f724e9-fda2-42fc-b4ef-2b342cab4976',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.670521] env[65660]: INFO networking_nsxv3.common.synchronization [None req-1c77816b-c600-4ab3-ae0c-39517e155578 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_rules [ 929.670521] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_rules [ 929.670521] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.670521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.670521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.670521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.670521] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.742743] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a127e711-32a8-4029-9706-258432d92a5a [ 929.743055] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.743200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.743266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.743478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.743564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.743710] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a127e711-32a8-4029-9706-258432d92a5a already deleted. [ 929.743762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a127e711-32a8-4029-9706-258432d92a5a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.858119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.858374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.858527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68f724e9-fda2-42fc-b4ef-2b342cab4976 with status ACTIVE [ 929.858750] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.858876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.858945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.859219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.859300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.859471] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.859569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.859620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.859773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.859841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.860163] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.860163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.860163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.860353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.860353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.860443] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68f724e9-fda2-42fc-b4ef-2b342cab4976 is going to be updated. [ 929.887061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.887214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.887279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.887590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.887764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.887764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f724e9-fda2-42fc-b4ef-2b342cab4976" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.978842] env[65660]: INFO networking_nsxv3.common.synchronization [None req-8608db45-c03e-47ba-918a-06fa656210d2 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_rules [ 929.979308] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_rules [ 929.980023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.980023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.193174] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.193317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.193362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.193848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.193848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.193848] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db already deleted. [ 930.193848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.194371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.194371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.194371] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.533923] env[65660]: INFO networking_nsxv3.common.synchronization [None req-a8a3e750-8780-41fd-892b-3298a3f02c99 None None] Enqueued Resource ID: 5b36c1a8-f37f-44f4-8456-5a6d774be765 with Priority: HIGHEST for action port [ 930.533923] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b36c1a8-f37f-44f4-8456-5a6d774be765 with Priority: HIGHEST for action port [ 930.533923] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b36c1a8-f37f-44f4-8456-5a6d774be765 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.533923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b36c1a8-f37f-44f4-8456-5a6d774be765" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.533923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b36c1a8-f37f-44f4-8456-5a6d774be765" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.533923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b36c1a8-f37f-44f4-8456-5a6d774be765" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.533923] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b36c1a8-f37f-44f4-8456-5a6d774be765',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.536194] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 930.536398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.715373] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.715657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.715657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.715825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.715914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.716014] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db already deleted. [ 930.716125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.957577] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 930.957920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.958112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.960281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.960281] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.960281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.960281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.960281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.960281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.960281] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.036851] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b36c1a8-f37f-44f4-8456-5a6d774be765 [ 931.037193] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.037505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.037505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.037711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.037807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.037902] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b36c1a8-f37f-44f4-8456-5a6d774be765 already deleted. [ 931.037993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b36c1a8-f37f-44f4-8456-5a6d774be765" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.371996] env[65660]: INFO networking_nsxv3.common.synchronization [None req-e1c6489f-d726-4acb-9859-99d162ae4fff None None] Enqueued Resource ID: b60f91ab-4e7c-41a6-96d6-a28d9078e6cf with Priority: HIGHEST for action port [ 931.372566] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f91ab-4e7c-41a6-96d6-a28d9078e6cf with Priority: HIGHEST for action port [ 931.373842] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60f91ab-4e7c-41a6-96d6-a28d9078e6cf taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.374405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60f91ab-4e7c-41a6-96d6-a28d9078e6cf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.374405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60f91ab-4e7c-41a6-96d6-a28d9078e6cf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.374405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60f91ab-4e7c-41a6-96d6-a28d9078e6cf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.374405] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60f91ab-4e7c-41a6-96d6-a28d9078e6cf',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.465638] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.876308] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b60f91ab-4e7c-41a6-96d6-a28d9078e6cf [ 931.876578] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.876688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.876755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.876967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.877063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.877161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b60f91ab-4e7c-41a6-96d6-a28d9078e6cf already deleted. [ 931.878059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60f91ab-4e7c-41a6-96d6-a28d9078e6cf" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.967018] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.469720] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.469888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.469960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.470198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.470291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.470469] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be updated. [ 932.502858] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.502858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.502858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.502858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.502858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.511474] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: IN_PROGRESS for 2s [ 932.903181] env[65660]: INFO networking_nsxv3.common.synchronization [None req-700ca01e-779d-437f-8876-1cc762bbb20a None None] Enqueued Resource ID: f099625d-2883-464a-8ac8-9343a7da6ea5 with Priority: HIGHEST for action port [ 932.903181] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f099625d-2883-464a-8ac8-9343a7da6ea5 with Priority: HIGHEST for action port [ 932.903181] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f099625d-2883-464a-8ac8-9343a7da6ea5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.903181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f099625d-2883-464a-8ac8-9343a7da6ea5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.903181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f099625d-2883-464a-8ac8-9343a7da6ea5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.903181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f099625d-2883-464a-8ac8-9343a7da6ea5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.903181] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f099625d-2883-464a-8ac8-9343a7da6ea5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.407798] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f099625d-2883-464a-8ac8-9343a7da6ea5 [ 933.408794] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.408794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.408794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.408794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.408794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.408794] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f099625d-2883-464a-8ac8-9343a7da6ea5 already deleted. [ 933.408794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f099625d-2883-464a-8ac8-9343a7da6ea5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.525432] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.525432] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.525432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.525432] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.027642] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.027814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.027891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.028137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.028321] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.028425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.028488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.028637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.028724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.028814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.028958] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.029064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.029125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.029266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.029402] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.029491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.029549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.029684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.029767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.029855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.029943] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.388683] env[65660]: INFO networking_nsxv3.common.synchronization [req-4cf0fa25-0622-456a-b934-7bf4efa6c7ec req-991d0840-08bb-479a-9618-19781f070434 tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 935.389231] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 935.389573] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.389707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.389761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.390058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.390230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.390326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.390403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.391460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.391558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.391682] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.533154] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 527845fc-1b66-4f17-85ee-b1fc80f19f8e: rpc.has_security_group_logging(os_id): False [ 935.553537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.553801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.553886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.554115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.554205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.554415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.554489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.554550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.554792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.554914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.555532] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.555532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.555532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.555532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.555532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.555851] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.555851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.555851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.556049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.556362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.556362] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be updated. [ 935.629478] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.629810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.630112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.630514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.632603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.646513] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: IN_PROGRESS for 2s [ 935.849889] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.850877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.850877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.850877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.850877] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.851198] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.851337] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.851779] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.851921] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.852172] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.852354] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.852776] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.852776] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.852776] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.852914] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.853051] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.885652] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.885652] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.885652] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.885652] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.885652] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.886391] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.886391] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.886671] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.886821] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.894878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.895055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.895100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.895558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.896115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.896115] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.896115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.896115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.896423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.896423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.896423] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 already deleted. [ 935.896542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.390301] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.390548] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.390673] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.392115] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.392291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.392469] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b not found, creating... [ 936.392761] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.392934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.393064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.393400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.393448] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.393864] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.397881] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397881] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.397881] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.398104] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.398155] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b is going to be created. [ 936.424285] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.424580] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.424810] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.425239] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.425609] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.425983] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.700356] env[65660]: INFO networking_nsxv3.common.synchronization [req-ca86009b-bef9-4373-b089-ee4f56df9383 req-175f90b1-9809-4cf2-8764-61b826af6d15 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 936.700886] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 936.701207] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.701856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.701941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.702164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.702326] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.702424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.702490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.702634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.702719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.702812] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.191788] env[65660]: INFO networking_nsxv3.common.synchronization [req-4cf0fa25-0622-456a-b934-7bf4efa6c7ec req-8a7e082a-ac6d-4966-87d3-864eaa65df5e service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 937.191883] env[65660]: INFO networking_nsxv3.common.synchronization [req-4cf0fa25-0622-456a-b934-7bf4efa6c7ec req-8a7e082a-ac6d-4966-87d3-864eaa65df5e service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 937.192211] env[65660]: INFO networking_nsxv3.common.synchronization [req-4cf0fa25-0622-456a-b934-7bf4efa6c7ec req-8a7e082a-ac6d-4966-87d3-864eaa65df5e service nova] Enqueued Resource ID: dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b with Priority: HIGHEST for action port [ 937.192691] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 937.193071] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 937.193071] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b with Priority: HIGHEST for action port [ 937.193223] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.193377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.193484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.193772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.194066] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.195385] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.197132] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.197132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.197132] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.199107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.199446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.199446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.199446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.199580] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.205091] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.205236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.205236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.205432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.205524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.205737] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.205801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.205859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.205996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.206088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.206160] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 937.242420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.242420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.242420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.242420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.242681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.254410] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 937.628376] env[65660]: INFO networking_nsxv3.common.synchronization [req-26e7ecd3-f0a7-4275-9c9e-61d407154743 req-8035b439-a99b-4657-b026-92dc2c6e1f7a tempest-ServersAdminTestJSON-1204081429 tempest-ServersAdminTestJSON-1204081429-project-member] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 937.629109] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGHEST for action security_group_members [ 937.629522] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.629601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.629601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.629808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.629960] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.630074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.630133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.630277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.630362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.630530] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.662020] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 937.662279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.701608] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.702636] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.702789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.703143] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b with status ACTIVE [ 937.703756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.703756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.703756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.703756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.703973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.704033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.704098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.704175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.704412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.704412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.704607] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.705743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.705743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.705743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.705743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.705743] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b is going to be updated. [ 937.726583] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.727013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.727013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.727159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.727667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.727667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd6b0b20-1dfd-4b30-a74e-8c6d302d4d3b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.920380] env[65660]: INFO networking_nsxv3.common.synchronization [req-d7d52b66-4939-42d6-844d-9151bc3ab6d5 req-ec58626e-0cc5-494d-8108-a608fa7f25a8 tempest-ServersNegativeTestJSON-634766943 tempest-ServersNegativeTestJSON-634766943-project-member] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 937.920925] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 937.921249] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.921374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.921439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.921645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.921803] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.921905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.921967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.922141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.922226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.922317] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.134530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.134530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.134530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.136451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.174268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.174268] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.174268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.174268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.174268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.174268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.174268] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be updated. [ 938.204125] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.215091] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.215242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.215350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.215658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.215810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.240403] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: IN_PROGRESS for 2s [ 938.347484] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.347827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.347827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.348509] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.348855] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.349074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.349327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.349511] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.349691] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.349935] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.350550] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.350550] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.350550] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.350550] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.350804] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.350916] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.376861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.376861] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.377318] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.377318] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.377625] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-95b6275f-f63c-421d-8d78-51c1f644b6c9 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.377826] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.378021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.378378] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.378521] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b6275f-f63c-421d-8d78-51c1f644b6c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.425892] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.707087] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.707526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.707526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.707641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.707776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.707895] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be created. [ 938.735366] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.735509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.735578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.735801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.735953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.747527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: UNINITIALIZED for 2s [ 938.882236] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.882236] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.882534] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.884327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.884327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.884327] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 95b6275f-f63c-421d-8d78-51c1f644b6c9 not found, creating... [ 938.884327] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.884327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.884327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.884327] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.884693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.884939] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.885150] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.885299] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.885527] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.885725] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.885920] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 95b6275f-f63c-421d-8d78-51c1f644b6c9 is going to be created. [ 938.912863] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.913116] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.913224] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.913571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.913863] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.914127] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.927826] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.266577] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 939.266994] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 939.267415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.432253] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.432430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.432501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.432719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.432809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.432985] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 939.469228] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.469407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.469487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.469707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.469884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.483998] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 939.680451] env[65660]: INFO networking_nsxv3.common.synchronization [req-d7d52b66-4939-42d6-844d-9151bc3ab6d5 req-341b9a2e-dfb6-41c4-aca1-6bb26c1b08fe service nova] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_rules [ 939.680654] env[65660]: INFO networking_nsxv3.common.synchronization [req-d7d52b66-4939-42d6-844d-9151bc3ab6d5 req-341b9a2e-dfb6-41c4-aca1-6bb26c1b08fe service nova] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 939.680744] env[65660]: INFO networking_nsxv3.common.synchronization [req-d7d52b66-4939-42d6-844d-9151bc3ab6d5 req-341b9a2e-dfb6-41c4-aca1-6bb26c1b08fe service nova] Enqueued Resource ID: 95b6275f-f63c-421d-8d78-51c1f644b6c9 with Priority: HIGHEST for action port [ 939.681986] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_rules [ 939.682341] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 939.682341] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b6275f-f63c-421d-8d78-51c1f644b6c9 with Priority: HIGHEST for action port [ 939.685908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.685908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.685908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.685908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b6275f-f63c-421d-8d78-51c1f644b6c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.685908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.685908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b6275f-f63c-421d-8d78-51c1f644b6c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.980662] env[65660]: INFO networking_nsxv3.common.synchronization [req-f80dee64-3a68-40ce-b0ef-7b47e8f1ca8c req-7bb77eb9-c7d0-4125-af3f-c04265e88ea3 tempest-ServersWithSpecificFlavorTestJSON-1002304921 tempest-ServersWithSpecificFlavorTestJSON-1002304921-project-member] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 939.982068] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGHEST for action security_group_members [ 939.982068] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.982068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.982068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.982353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.982451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.982722] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.982810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.982999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.983102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.983200] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.189161] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.189336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.189560] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95b6275f-f63c-421d-8d78-51c1f644b6c9 with status ACTIVE [ 940.189744] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.190819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.190819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.190819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.191252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.191617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.191801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.191890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.192345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.192345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.193193] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.193193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.193193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.193193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.193413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.193413] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95b6275f-f63c-421d-8d78-51c1f644b6c9 is going to be updated. [ 940.224670] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.224893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.224957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.225255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.225393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.225555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b6275f-f63c-421d-8d78-51c1f644b6c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.257784] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da44bcac-8dcd-43ae-b931-eee44940a29b in Status: SUCCESS [ 940.257978] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b deletion is rescheduled due to dependency. [ 940.258158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.486371] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.486371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.486550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.486714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.487419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.487419] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.487419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.487419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.487419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.487419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.487775] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be updated. [ 940.528308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.528308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.528308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.528308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.528308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.537223] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: IN_PROGRESS for 2s [ 940.756645] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 940.756816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.757269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.757269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.757420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.757512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.757588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.757750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.757841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.757929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.758034] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.263021] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.497359] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.497359] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.497359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.497359] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.764911] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f149ebe9-de13-482c-885e-b787b9881cd4: rpc.has_security_group_logging(os_id): False [ 941.785242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.785519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.785519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.785690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.785787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.786151] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.786292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.786358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.786532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.786610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.786697] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be created. [ 941.877757] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.877757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.877757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.877757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.878783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.893861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 942.000784] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.382621] env[65660]: INFO networking_nsxv3.common.synchronization [req-3ca7afee-19a8-4b8c-ae0a-0e3ecf82a267 req-9f0e65b6-03ef-4555-b8ea-4a17150e56cb tempest-ServerActionsV293TestJSON-91498199 tempest-ServerActionsV293TestJSON-91498199-project-member] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_members [ 942.383218] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGHEST for action security_group_members [ 942.383524] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.383646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.383719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.383968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.384159] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.384274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.384351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.384504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.384595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.384711] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.504616] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.547903] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 in Status: SUCCESS [ 942.548144] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 deletion is rescheduled due to dependency. [ 942.548297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.886944] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.887111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.887179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.887425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.913583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.913583] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.913583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.913583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.913583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.913583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.913583] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a is going to be updated. [ 942.947261] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.947261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.947261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.947261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.947261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.959810] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a in Status: IN_PROGRESS for 2s [ 943.007926] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.007926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.007926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.008156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.008156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.008214] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 943.073058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.073342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.073653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.073875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.074085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.093293] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 943.907799] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 943.908177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.036153] env[65660]: INFO networking_nsxv3.common.synchronization [req-f861f9b2-631d-454b-8a6c-20f799b88ba3 req-576fe0bd-727e-4e48-b901-7249113d7f41 tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 944.036778] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 944.037324] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.037471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.037559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.038640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.038640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.038640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.038640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.038640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.039139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.039139] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.542255] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.542418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.542487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.542713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.542799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.543070] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.544387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.544387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.544387] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 944.571130] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.571560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.571560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.571669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.573986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.582696] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 944.969379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a in Status: SUCCESS [ 944.969752] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a deletion is rescheduled due to dependency. [ 944.969752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.105097] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 945.105097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.105226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.105363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.105518] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.105773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.105773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.105862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.105918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.106482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.106482] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.370778] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ae0f49-3418-45dd-826b-0019fedc82e0 req-5710af6a-eae7-4d48-8c8c-d26435ef4c09 tempest-ServerMetadataTestJSON-1945723293 tempest-ServerMetadataTestJSON-1945723293-project-member] Enqueued Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_members [ 945.372025] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_members [ 945.372025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.372025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.372025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.372272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.372467] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.372613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.374700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.374700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.374700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.374700] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.610040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.610040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.610040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.610462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.610462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.610555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.610598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.610898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.610934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.611044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.611404] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.611404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.611404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.611740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.611740] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.611943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.612053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.612183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.612286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.612379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.612471] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.756485] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.756713] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-527" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.756843] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-527" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.757256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-527" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.757529] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.757701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.757834] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.758089] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.758243] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.758452] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.758622] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.758735] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.758820] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.758892] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.759024] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.759158] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.780731] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.780987] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.781195] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.781440] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-527" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.782093] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-780c238d-5139-41a2-8fe2-1dad05fd1fed taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.782093] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.782487] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.782636] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.782776] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('780c238d-5139-41a2-8fe2-1dad05fd1fed',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.875854] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.875854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.875854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.875854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.875854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.876147] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.876247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.876247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.877791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.877791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.877791] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd660da0-3553-4221-8c8e-0723ad648c55 already deleted. [ 945.877791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.114614] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3402fe38-bb82-4e23-ab22-23f54a22de87: rpc.has_security_group_logging(os_id): False [ 946.134753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.134753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.134753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.134753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.134753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.134753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.134753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.134753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.135089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.135089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.135172] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.135216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.135268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.135426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.135496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.135684] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.135776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.135836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.135974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.138745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.138745] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 946.203452] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.203621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.203673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.203909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.204083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.217347] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 946.289291] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.289608] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.289736] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.290034] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.290180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.290333] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 780c238d-5139-41a2-8fe2-1dad05fd1fed not found, creating... [ 946.290595] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.290888] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.291094] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.291326] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.291466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.291824] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.291960] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.292969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.292969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.292969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.292969] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 780c238d-5139-41a2-8fe2-1dad05fd1fed is going to be created. [ 946.317837] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.318018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.318150] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.318437] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.318678] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.319033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.595669] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 946.595859] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 946.595984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.777072] env[65660]: INFO networking_nsxv3.common.synchronization [req-0ef050a1-8d36-4eaf-8722-ad45e73502e1 req-12239189-3d58-4e3e-976b-4f165a429d0e tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 946.777637] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 946.777944] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.778083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.778149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.778355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.778514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.778613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.778676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.778821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.778910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.779012] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.058670] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ae0f49-3418-45dd-826b-0019fedc82e0 req-73cc9490-ed04-4222-94ad-cf87cc092b96 service nova] Enqueued Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_rules [ 947.058798] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ae0f49-3418-45dd-826b-0019fedc82e0 req-73cc9490-ed04-4222-94ad-cf87cc092b96 service nova] Enqueued Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_members [ 947.058974] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ae0f49-3418-45dd-826b-0019fedc82e0 req-73cc9490-ed04-4222-94ad-cf87cc092b96 service nova] Enqueued Resource ID: 780c238d-5139-41a2-8fe2-1dad05fd1fed with Priority: HIGHEST for action port [ 947.059813] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_rules [ 947.059813] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_members [ 947.059813] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 780c238d-5139-41a2-8fe2-1dad05fd1fed with Priority: HIGHEST for action port [ 947.060967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.060967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.060967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.060967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.061314] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.063075] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.063341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.063442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.065079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.065079] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.065079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.065515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.065962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.067983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.067983] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.068810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-780c238d-5139-41a2-8fe2-1dad05fd1fed taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.068997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.069266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.069266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.069540] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('780c238d-5139-41a2-8fe2-1dad05fd1fed',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.206878] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.207199] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.207281] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.207563] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.207966] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.208172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.208263] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.208492] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.208690] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.208913] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.209042] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.209153] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.209269] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.209377] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.209480] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.209608] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.235374] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.235585] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.235661] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.236533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.236533] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-5f65be9b-63ee-447e-af71-f8d9b4006310 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.236533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.236533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.237881] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.237881] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f65be9b-63ee-447e-af71-f8d9b4006310',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.282012] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.282245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.282395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.282753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.282940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.283237] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.283432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.283580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.283886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.284050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.284206] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be deleted. [ 947.313298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.313496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.313496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.313852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.313977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.314164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.571577] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.571577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.571785] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.573170] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 780c238d-5139-41a2-8fe2-1dad05fd1fed with status ACTIVE [ 947.573310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.573403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.573475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.573677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.573772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.574031] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.574135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.574190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.574359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.574437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.574618] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.574696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.574753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.574983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.575150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.575251] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 780c238d-5139-41a2-8fe2-1dad05fd1fed is going to be updated. [ 947.600104] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.600271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.600345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.600538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.600670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.600831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-780c238d-5139-41a2-8fe2-1dad05fd1fed" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.739669] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.739906] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.741101] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.741101] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.741101] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.741101] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 5f65be9b-63ee-447e-af71-f8d9b4006310 not found, creating... [ 947.741101] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.741101] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.741652] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.741652] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.741652] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.741968] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.742173] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.742271] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.742632] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.742632] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.742749] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 5f65be9b-63ee-447e-af71-f8d9b4006310 is going to be created. [ 947.761080] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.761358] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.761443] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.761652] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.761873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.762114] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.076967] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.244304] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 948.244553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.506488] env[65660]: INFO networking_nsxv3.common.synchronization [req-0ef050a1-8d36-4eaf-8722-ad45e73502e1 req-125628a6-5c87-4bb5-a56c-ac5438b80801 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 948.509102] env[65660]: INFO networking_nsxv3.common.synchronization [req-0ef050a1-8d36-4eaf-8722-ad45e73502e1 req-125628a6-5c87-4bb5-a56c-ac5438b80801 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 948.509102] env[65660]: INFO networking_nsxv3.common.synchronization [req-0ef050a1-8d36-4eaf-8722-ad45e73502e1 req-125628a6-5c87-4bb5-a56c-ac5438b80801 service nova] Enqueued Resource ID: 5f65be9b-63ee-447e-af71-f8d9b4006310 with Priority: HIGHEST for action port [ 948.509102] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 948.509102] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 948.509102] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f65be9b-63ee-447e-af71-f8d9b4006310 with Priority: HIGHEST for action port [ 948.509102] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.509102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.509102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.509102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.509102] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.509552] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.509552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.509552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.509654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.509893] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.509893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.509991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.510234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.510234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.510234] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.511014] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f65be9b-63ee-447e-af71-f8d9b4006310 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.511301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.511403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.511509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.511584] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f65be9b-63ee-447e-af71-f8d9b4006310',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.689380] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.689585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.689659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.689870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.689957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.690067] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd660da0-3553-4221-8c8e-0723ad648c55 is going to be created. [ 948.717214] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.717404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.717532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.717627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.717789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.730938] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd660da0-3553-4221-8c8e-0723ad648c55 in Status: UNINITIALIZED for 2s [ 949.014097] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f65be9b-63ee-447e-af71-f8d9b4006310 with status ACTIVE [ 949.014434] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.014586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.014666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.014925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.016319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.016319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.016319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.016640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.016640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.016640] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f65be9b-63ee-447e-af71-f8d9b4006310 is going to be updated. [ 949.017664] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.017755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.017922] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.044167] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.044339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.044384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.044615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.044754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.044971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f65be9b-63ee-447e-af71-f8d9b4006310" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.522122] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.024801] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.025237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.025237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.025335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.025367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.025468] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be created. [ 950.049119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.049282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.049381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.049540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.050239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.062676] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: UNINITIALIZED for 2s [ 950.528845] env[65660]: INFO networking_nsxv3.common.synchronization [req-9419db6b-ca5f-4c59-a27f-9864e93c25d9 req-cb90fbf4-053a-4074-ad5a-2b53e06cc3a5 tempest-ServerAddressesTestJSON-330470143 tempest-ServerAddressesTestJSON-330470143-project-member] Enqueued Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_members [ 950.529748] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_members [ 950.530254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.530420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.530531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.530885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.531166] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.531334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.531445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.531666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.531842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.532624] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.741808] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd660da0-3553-4221-8c8e-0723ad648c55 in Status: SUCCESS [ 950.742059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.742163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.742354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.742973] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.742973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.742973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.742973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.742973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.743679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.743679] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.851299] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.851478] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-775" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.851659] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-775" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.852108] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-775" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.852385] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.852572] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.852655] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.852879] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.853033] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.853265] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.853378] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.853456] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.853556] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.853660] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.853792] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.853932] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.873957] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.874272] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.874491] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.874873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-775" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.875240] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-cceb6a57-de87-43bf-8704-ecb955ec31b8 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.875506] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.875728] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.876192] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.876415] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cceb6a57-de87-43bf-8704-ecb955ec31b8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.035517] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.035790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.035887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.036242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.036360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.036633] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.036754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.036828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.037072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.037256] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 already deleted. [ 951.037355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.246101] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.246294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.246386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.246570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.246753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.246879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.246947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.247084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.247174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.247263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.247413] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.247498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.247557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.247696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.247841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.247947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.248206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.251436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.251637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.251857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.251927] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.378989] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.379267] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.379505] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.380249] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.380437] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.380647] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port cceb6a57-de87-43bf-8704-ecb955ec31b8 not found, creating... [ 951.380936] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.381059] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.381172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.381402] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.381537] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.381847] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.381989] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.382151] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.382369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.382499] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.382664] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: cceb6a57-de87-43bf-8704-ecb955ec31b8 is going to be created. [ 951.404745] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.405180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.405180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.405466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.405694] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.405924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.754294] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd660da0-3553-4221-8c8e-0723ad648c55: rpc.has_security_group_logging(os_id): False [ 951.774901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.775123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.775189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.775443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.775539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.775763] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.775862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.775925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.776099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.776225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.776381] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.776481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.776533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.776751] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.776840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.777086] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.777206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.777244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.777405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.777513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.777572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd660da0-3553-4221-8c8e-0723ad648c55 is going to be created. [ 951.840612] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.840829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.840916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.841183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.841372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.870065] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd660da0-3553-4221-8c8e-0723ad648c55 in Status: IN_PROGRESS for 2s [ 952.076593] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 952.076593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.076828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.077193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.077472] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.077664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.077785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.078089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.078194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.078306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.078522] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.148803] env[65660]: INFO networking_nsxv3.common.synchronization [req-9419db6b-ca5f-4c59-a27f-9864e93c25d9 req-9d75b9ab-13a8-4732-9d95-7674cc42d07c service nova] Enqueued Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_rules [ 952.149019] env[65660]: INFO networking_nsxv3.common.synchronization [req-9419db6b-ca5f-4c59-a27f-9864e93c25d9 req-9d75b9ab-13a8-4732-9d95-7674cc42d07c service nova] Enqueued Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_members [ 952.149212] env[65660]: INFO networking_nsxv3.common.synchronization [req-9419db6b-ca5f-4c59-a27f-9864e93c25d9 req-9d75b9ab-13a8-4732-9d95-7674cc42d07c service nova] Enqueued Resource ID: cceb6a57-de87-43bf-8704-ecb955ec31b8 with Priority: HIGHEST for action port [ 952.149743] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_rules [ 952.149897] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_members [ 952.149981] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cceb6a57-de87-43bf-8704-ecb955ec31b8 with Priority: HIGHEST for action port [ 952.157019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.157019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.157019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.157019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.157019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.157019] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.158399] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-cceb6a57-de87-43bf-8704-ecb955ec31b8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.159526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.160394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.160764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.161038] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cceb6a57-de87-43bf-8704-ecb955ec31b8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.580996] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.580996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.580996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.581364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.581587] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.581740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.582498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.582498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.582498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.582498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.582779] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.582779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.582886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.583451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.583696] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.583939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.584118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.584530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.584618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.584799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.585038] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.616396] env[65660]: INFO networking_nsxv3.common.synchronization [req-f7175a48-ae17-4b2a-8a79-332a9f344741 req-5f09a0a1-a6c2-4d6a-894e-615421c204fa tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 952.616841] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 952.617193] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.617350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.617442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.617664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.617872] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.618062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.618254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.618518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.618734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.618937] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.663290] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cceb6a57-de87-43bf-8704-ecb955ec31b8 with status ACTIVE [ 952.663509] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.664409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.664409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.664633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.664722] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.665350] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.665480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.665546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.665707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.665797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.665988] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.666101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.666174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.666297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.666375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.666451] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cceb6a57-de87-43bf-8704-ecb955ec31b8 is going to be updated. [ 952.667718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.667842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.668103] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.701455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.701778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.701778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.701903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.702018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.702182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cceb6a57-de87-43bf-8704-ecb955ec31b8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.088091] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaef59ac-b94f-47d8-8852-ec864d2e9eeb: rpc.has_security_group_logging(os_id): False [ 953.110619] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.110731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.110731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.110947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.111052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.111398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.111508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.111578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.111778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.112077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.112077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.112169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.112212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.112355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.112429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.112624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.112807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.112889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.113048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.113124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.113210] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be created. [ 953.123753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.123753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.123753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.123753] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be updated. [ 953.171408] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.190964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.191155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.191223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.191438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.191579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.204807] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: IN_PROGRESS for 2s [ 953.214239] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.214493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.214493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.214680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.214878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.239335] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 953.352332] env[65660]: INFO networking_nsxv3.common.synchronization [req-00739ab6-8937-459a-b91a-a6f7b5120c9d req-0d0b5653-a0dd-4235-be4a-96c43aa9b0ba tempest-ServersNegativeTestJSON-634766943 tempest-ServersNegativeTestJSON-634766943-project-member] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 953.353020] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 953.354163] env[65660]: INFO networking_nsxv3.common.synchronization [req-d2261a7e-50aa-4cb7-8c82-efcd989f4620 req-008a995e-7085-4e3b-91cf-d91d25de5b43 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_members [ 953.354302] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.354457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.354501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.354710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.354880] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.355027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.355116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.355314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.355406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.355502] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.356750] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_members [ 953.357247] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.359424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.359518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.359722] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.359883] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.359983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.360085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.360208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.360302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.360398] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.676107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.677287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.677287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.677287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.677287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.677287] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 is going to be created. [ 953.702824] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.702974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.703057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.703537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.703712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.715260] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 in Status: UNINITIALIZED for 2s [ 953.750357] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.751039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.751039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.751039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.751213] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.751646] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.751646] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.751766] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.751912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.752940] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.753021] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.753565] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.753565] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.753565] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.753565] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.753565] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.775471] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.775471] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.775471] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.775471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.775471] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.775471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.775471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.775471] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.775471] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f96cfe7-2732-400c-ad92-2fdeebaf0c36',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.857468] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.864622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.864735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.864787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.865235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.865235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.865346] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.865428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.865468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.865614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.865685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.866325] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db already deleted. [ 953.866325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.889668] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd660da0-3553-4221-8c8e-0723ad648c55 in Status: SUCCESS [ 953.889932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.148241] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2e022ed8-1234-4eac-b854-7a3bccc0f60e tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 954.148884] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 954.149070] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.149182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.149243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.149444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.149605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.149672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.149732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.149873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.149953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.150206] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.281513] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.281768] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.281956] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.282300] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.282364] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.282512] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 2f96cfe7-2732-400c-ad92-2fdeebaf0c36 not found, creating... [ 954.282774] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.282932] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.283061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.283280] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.283417] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.283698] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.283933] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.284088] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.285175] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.285175] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.285175] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 2f96cfe7-2732-400c-ad92-2fdeebaf0c36 is going to be created. [ 954.316562] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.318361] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.318361] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.318361] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.318361] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.318579] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.360123] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.652295] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.863609] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.863851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.863851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.864110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.864210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.864313] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 954.900135] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.900353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.900353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.900629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.900883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.911484] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 955.037418] env[65660]: INFO networking_nsxv3.common.synchronization [req-d2261a7e-50aa-4cb7-8c82-efcd989f4620 req-23ccb151-19da-4165-bf04-7350b77f59c0 service nova] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_rules [ 955.037685] env[65660]: INFO networking_nsxv3.common.synchronization [req-d2261a7e-50aa-4cb7-8c82-efcd989f4620 req-23ccb151-19da-4165-bf04-7350b77f59c0 service nova] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_members [ 955.037811] env[65660]: INFO networking_nsxv3.common.synchronization [req-d2261a7e-50aa-4cb7-8c82-efcd989f4620 req-23ccb151-19da-4165-bf04-7350b77f59c0 service nova] Enqueued Resource ID: 2f96cfe7-2732-400c-ad92-2fdeebaf0c36 with Priority: HIGHEST for action port [ 955.038427] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_rules [ 955.038634] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_members [ 955.038708] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f96cfe7-2732-400c-ad92-2fdeebaf0c36 with Priority: HIGHEST for action port [ 955.039245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.039245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.039245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.039451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.039777] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.040503] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.040763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.040917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.041100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.041276] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.042719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.042719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.042719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.042719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.042719] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.044035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.044035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.044035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.044179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.044179] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f96cfe7-2732-400c-ad92-2fdeebaf0c36',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.154462] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.214842] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: SUCCESS [ 955.214842] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 deletion is rescheduled due to dependency. [ 955.214842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.252187] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 955.252414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.546909] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.547151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.547439] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.548571] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f96cfe7-2732-400c-ad92-2fdeebaf0c36 with status ACTIVE [ 955.548781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.548901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.548966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.549245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.549555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.549775] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.549990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.555033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.555033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.555033] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f96cfe7-2732-400c-ad92-2fdeebaf0c36 is going to be updated. [ 955.576821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.577010] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.577111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.577355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.577527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.577716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f96cfe7-2732-400c-ad92-2fdeebaf0c36" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.657734] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.657734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.657734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.657734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.657734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.658129] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 955.710854] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.711069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.711163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.711491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.711733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.735816] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 955.736678] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 in Status: SUCCESS [ 955.736928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.737145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.737401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.737623] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.737794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.737883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.738112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.738229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.738344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.738465] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.054182] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.241205] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.241498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.241498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.241895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.242010] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.242155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.242204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.242371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.242471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.242584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.242762] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.242864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.242929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.243121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.243296] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.243415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.243493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.243664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.243740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.243989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.243989] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.556763] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.560162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.560295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.560619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.560683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.560756] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db is going to be created. [ 956.593339] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.593339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.593339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.593339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.593339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.614152] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a06f441-5f17-4ab5-b491-331edf1151db in Status: UNINITIALIZED for 2s [ 956.749719] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e152fef8-1030-4523-b8a3-d71ee61ec9e1: rpc.has_security_group_logging(os_id): False [ 956.771050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.771050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.771050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.771050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.771050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.771050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.771050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.771050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.771714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.772038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.772360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.773018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.773018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.773018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.773018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.773279] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.773475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.773613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.773849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.775832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.775832] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 is going to be created. [ 956.839698] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.840119] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.840306] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.840570] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.840858] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.841192] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.841370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.841595] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.841760] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.841971] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.842105] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.842181] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.842290] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.842395] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.842497] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.842627] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.845017] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.845202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.845304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.845546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.845809] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.865392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 in Status: IN_PROGRESS for 2s [ 956.866184] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.866368] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.866507] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.866677] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.866993] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-350acda6-d46b-40e4-8fe7-3e7edc448a25 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.867187] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.867325] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.867650] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.867790] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350acda6-d46b-40e4-8fe7-3e7edc448a25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.936470] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 956.936674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.374026] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.374026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 350acda6-d46b-40e4-8fe7-3e7edc448a25 not found, creating... [ 957.374026] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.374026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.375228] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.375285] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.375897] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.375897] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.376177] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.376177] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.376323] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 350acda6-d46b-40e4-8fe7-3e7edc448a25 is going to be created. [ 957.403235] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.403407] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.403466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.403703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.403971] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.404228] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.525478] env[65660]: INFO networking_nsxv3.common.synchronization [req-e411f78a-532a-4fac-86de-f2fa11c98dbe req-eaed830c-4201-4f10-9c46-0081b96003b9 tempest-ServersAdminNegativeTestJSON-1347068261 tempest-ServersAdminNegativeTestJSON-1347068261-project-member] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 957.525478] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 957.525746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.525896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.525983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.526217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.526370] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.526477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.526540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.526692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.526781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.526878] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.747196] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 957.747477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.029776] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.154859] env[65660]: INFO networking_nsxv3.common.synchronization [req-5a414150-df10-4288-8d7d-0229257e90f3 req-7e1d88e1-9cd9-4a78-a159-c250f1140874 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 958.154967] env[65660]: INFO networking_nsxv3.common.synchronization [req-5a414150-df10-4288-8d7d-0229257e90f3 req-7e1d88e1-9cd9-4a78-a159-c250f1140874 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 958.155167] env[65660]: INFO networking_nsxv3.common.synchronization [req-5a414150-df10-4288-8d7d-0229257e90f3 req-7e1d88e1-9cd9-4a78-a159-c250f1140874 service nova] Enqueued Resource ID: 350acda6-d46b-40e4-8fe7-3e7edc448a25 with Priority: HIGHEST for action port [ 958.155891] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 958.155989] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 958.156120] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350acda6-d46b-40e4-8fe7-3e7edc448a25 with Priority: HIGHEST for action port [ 958.156485] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.156650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.156767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.156920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.157017] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.158045] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.158185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.158257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.158470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.158656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.158749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.158814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.158980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.159090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.159215] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.160459] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-350acda6-d46b-40e4-8fe7-3e7edc448a25 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.160550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.160583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.160738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.160813] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350acda6-d46b-40e4-8fe7-3e7edc448a25',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.532273] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.627586] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a06f441-5f17-4ab5-b491-331edf1151db in Status: SUCCESS [ 958.627880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.628121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.628380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.628664] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.628792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.628860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.629053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.629152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.629214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.629296] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.662953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.663221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.663451] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.664921] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 350acda6-d46b-40e4-8fe7-3e7edc448a25 with status ACTIVE [ 958.665376] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.665576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.665690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.666250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.666250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.666445] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.666613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.666660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.668073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.668073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.668073] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.668073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.668073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.668073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.668073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.668073] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 350acda6-d46b-40e4-8fe7-3e7edc448a25 is going to be updated. [ 958.689448] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.689656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.689656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.689870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.690052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.690225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-350acda6-d46b-40e4-8fe7-3e7edc448a25" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.878609] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 in Status: SUCCESS [ 958.878877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.034519] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.034695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.034695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.034889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.035019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.035145] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be updated. [ 959.070968] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.071208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.071334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.072245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.072245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.083021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: IN_PROGRESS for 2s [ 959.131628] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.170822] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.634387] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a06f441-5f17-4ab5-b491-331edf1151db: rpc.has_security_group_logging(os_id): False [ 959.659140] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.659140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.659140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.659351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.659446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.659706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.659802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.659860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.660048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.660167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.660201] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db is going to be created. [ 959.673338] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.674046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.674046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.674168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.674259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.674373] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 959.708421] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.708594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.708594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.708852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.709068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.720882] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 959.759348] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.759348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.759348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.759348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.759348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.776109] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a06f441-5f17-4ab5-b491-331edf1151db in Status: IN_PROGRESS for 2s [ 961.093320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 961.093683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.733574] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 961.733789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.734107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.734330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.734596] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.734668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.734778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.734842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.735138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.735280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.735499] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.795214] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a06f441-5f17-4ab5-b491-331edf1151db in Status: SUCCESS [ 961.795515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.238311] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.238658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.238658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.238929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.239187] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.239335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.239422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.239619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.239743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.239860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.240089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.240246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.240305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.240509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.240700] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.240833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.240916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.241121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.241220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.241339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.241477] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.744115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaef59ac-b94f-47d8-8852-ec864d2e9eeb: rpc.has_security_group_logging(os_id): False [ 962.768231] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.768231] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.768231] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.768231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.768870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.769020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.769085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.769334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.769474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.769607] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 962.843205] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.843577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.843577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.843790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.844042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.860959] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 963.157567] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 963.157567] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 964.880081] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 964.880081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.173285] env[65660]: INFO networking_nsxv3.common.synchronization [req-483223c0-2a31-4435-81ab-552721c1c064 req-f1a9a03e-7f6e-4853-afcb-bd02ed300453 tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 967.174346] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 967.174904] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.174904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.175224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.175375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.175799] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.175799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.175799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.175939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.175939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.176014] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.681621] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.681835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.681882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.682139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.682242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.682463] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.682560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.682590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.682743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.682810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.682893] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 967.717464] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.717464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.717580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.717760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.717901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.728511] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 968.050788] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.051044] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.051218] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.051514] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.051785] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.052133] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.052218] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.052459] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.052558] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.052818] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.052938] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.053069] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.053184] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.053295] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.053410] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.053545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.186108] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.186469] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.133 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.186712] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.187017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-992" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.187533] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-09b47868-cfa9-4369-9ac4-8aadab89f3ea taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.187926] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.188139] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.188576] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.188809] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b47868-cfa9-4369-9ac4-8aadab89f3ea',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.691990] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.692304] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.692405] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.692703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.692858] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.693064] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 09b47868-cfa9-4369-9ac4-8aadab89f3ea not found, creating... [ 968.693319] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.693506] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.693641] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.694185] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.694275] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.694541] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.694729] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.694894] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.695195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.695358] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.695527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 09b47868-cfa9-4369-9ac4-8aadab89f3ea is going to be created. [ 968.719608] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.719829] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.719943] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.720256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.720505] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.721285] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.385405] env[65660]: INFO networking_nsxv3.common.synchronization [req-483223c0-2a31-4435-81ab-552721c1c064 req-d40a3a66-ba2d-4947-82a2-40c461d12938 service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 969.385405] env[65660]: INFO networking_nsxv3.common.synchronization [req-483223c0-2a31-4435-81ab-552721c1c064 req-d40a3a66-ba2d-4947-82a2-40c461d12938 service nova] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 969.385863] env[65660]: INFO networking_nsxv3.common.synchronization [req-483223c0-2a31-4435-81ab-552721c1c064 req-d40a3a66-ba2d-4947-82a2-40c461d12938 service nova] Enqueued Resource ID: 09b47868-cfa9-4369-9ac4-8aadab89f3ea with Priority: HIGHEST for action port [ 969.388504] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_rules [ 969.388504] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 969.388504] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09b47868-cfa9-4369-9ac4-8aadab89f3ea with Priority: HIGHEST for action port [ 969.388504] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.388784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.388957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.389254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.389424] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.390339] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.393330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.394028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-09b47868-cfa9-4369-9ac4-8aadab89f3ea taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.394028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.394028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.394549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.396235] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b47868-cfa9-4369-9ac4-8aadab89f3ea',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.579641] env[65660]: INFO networking_nsxv3.common.synchronization [req-3c971182-2ebb-49bd-aeff-471a3cdaec97 req-d17f2bc1-be8e-4bab-a328-4bf6ef01da9d tempest-ServerAddressesTestJSON-330470143 tempest-ServerAddressesTestJSON-330470143-project-member] Enqueued Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_members [ 969.580469] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 with Priority: HIGHEST for action security_group_members [ 969.581685] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e152fef8-1030-4523-b8a3-d71ee61ec9e1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.581876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.582023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.582288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.582491] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.582745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.582823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.582983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.583117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.583202] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e152fef8-1030-4523-b8a3-d71ee61ec9e1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.740527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 969.740761] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 969.740913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.741134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.741389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.741661] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.741789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.741852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.742120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.742244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.742381] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.897877] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.898183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.898504] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09b47868-cfa9-4369-9ac4-8aadab89f3ea with status ACTIVE [ 969.898868] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.899044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.899259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.899631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.899755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.900126] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.900361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.900547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.900901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.901015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.901354] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.901602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.901707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.902111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.902246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.902398] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09b47868-cfa9-4369-9ac4-8aadab89f3ea is going to be updated. [ 969.927439] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.927635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.927701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.927963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.928050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.928395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09b47868-cfa9-4369-9ac4-8aadab89f3ea" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.085764] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.085764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.086346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.086346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.086346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.087186] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.087186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.087186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.087186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.087186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.087186] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 is going to be updated. [ 970.139416] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.139416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.139416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.139416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.139742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.157204] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 in Status: IN_PROGRESS for 2s [ 970.245604] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.747490] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.251881] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.252127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.252236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.252484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.252574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.252674] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 971.286415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.287615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.287615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.287615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.287615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.300231] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 971.413248] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f668b6a7-a163-4d63-9f0f-fe4ceaae890c None None] Enqueued Resource ID: 02692137-df93-480a-a6d1-c53c9a98f82a with Priority: HIGHEST for action port [ 971.413248] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02692137-df93-480a-a6d1-c53c9a98f82a with Priority: HIGHEST for action port [ 971.413248] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-02692137-df93-480a-a6d1-c53c9a98f82a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.413248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02692137-df93-480a-a6d1-c53c9a98f82a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.413248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02692137-df93-480a-a6d1-c53c9a98f82a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.413248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02692137-df93-480a-a6d1-c53c9a98f82a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.413248] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02692137-df93-480a-a6d1-c53c9a98f82a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.591162] env[65660]: INFO networking_nsxv3.common.synchronization [req-a4b5e39f-b6fb-4f81-81fd-270ef21d0615 req-e60d2ba8-ad12-42f5-891e-d0bee9e492f0 tempest-ServerMetadataTestJSON-1945723293 tempest-ServerMetadataTestJSON-1945723293-project-member] Enqueued Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_members [ 971.593292] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGHEST for action security_group_members [ 971.593292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.593292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.593292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.593292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.593292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.593292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.593292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.593292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.594756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.595051] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.914882] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02692137-df93-480a-a6d1-c53c9a98f82a [ 971.915373] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.915373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.915578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.915707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.915816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.915921] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02692137-df93-480a-a6d1-c53c9a98f82a already deleted. [ 971.916017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02692137-df93-480a-a6d1-c53c9a98f82a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.099395] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.099395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.099614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.099976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.099976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.100200] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.100297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.100388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.100749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.101244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.101244] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd660da0-3553-4221-8c8e-0723ad648c55 is going to be updated. [ 972.140545] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.140848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.141173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.141540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.142256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.156573] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd660da0-3553-4221-8c8e-0723ad648c55 in Status: IN_PROGRESS for 2s [ 972.172243] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 in Status: SUCCESS [ 972.172554] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e152fef8-1030-4523-b8a3-d71ee61ec9e1 deletion is rescheduled due to dependency. [ 972.172713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e152fef8-1030-4523-b8a3-d71ee61ec9e1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.612376] env[65660]: INFO networking_nsxv3.common.synchronization [None req-e0d042de-1c98-4118-a938-1400f8e548cd tempest-ServersV294TestFqdnHostnames-1957478415 tempest-ServersV294TestFqdnHostnames-1957478415-project-member] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_rules [ 972.612964] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_rules [ 972.613298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.613423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.613552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.613808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.613887] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.759971] env[65660]: INFO networking_nsxv3.common.synchronization [None req-98d68992-c506-4fab-a3df-71788d40c419 tempest-ServersV294TestFqdnHostnames-1957478415 tempest-ServersV294TestFqdnHostnames-1957478415-project-member] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_rules [ 972.760381] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_rules [ 972.760465] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.760584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.148225] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.148665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.148665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.148665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.148814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.148814] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 already deleted. [ 973.148946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.149070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.149271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.149328] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.322824] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 973.323300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.323495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.323730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.323928] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.324153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.324225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.324390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.324471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.324568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.324647] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.676186] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.676186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.676186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.676186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.676186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.676186] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 already deleted. [ 973.676186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.787870] env[65660]: INFO networking_nsxv3.common.synchronization [req-51b33419-4377-401d-8aa0-cfa579a4afa8 req-f26dfeb6-2ea2-4fba-a27a-e2494ae51243 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 973.788466] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 973.788771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.788889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.789149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.789323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.789377] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.789594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.789594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.789758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.789758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.789842] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.827468] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.827674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.827674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.827882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.828057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.828160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.828219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.828388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.828490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.828591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.828764] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.828837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.828891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.829032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.829134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.829233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.829292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.829409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.829480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.829554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.830323] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.063674] env[65660]: INFO networking_nsxv3.common.synchronization [None req-b81cac19-3685-4a0c-8eb7-4dd577f25d1f tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 974.064469] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 974.064904] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.065134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.170027] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd660da0-3553-4221-8c8e-0723ad648c55 in Status: SUCCESS [ 974.172476] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd660da0-3553-4221-8c8e-0723ad648c55 deletion is rescheduled due to dependency. [ 974.172476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.292183] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.333711] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 335a6866-6ca7-4c63-a411-59c67e151de0: rpc.has_security_group_logging(os_id): False [ 974.355098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.355291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.355349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.355570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.355860] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.355956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.356029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.356181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.356256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.356497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.356600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.356654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.356792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.356898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.357377] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.357494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.357555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.357698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.357768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.357851] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 974.424936] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.424936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.424936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.424936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.424936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.440991] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 974.557524] env[65660]: INFO networking_nsxv3.common.synchronization [None req-85ffde98-5e75-4a28-a751-9fed10cacdc6 None None] Enqueued Resource ID: 6836245a-93c1-43ea-a357-0d0fb46c34dd with Priority: HIGHEST for action port [ 974.561034] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6836245a-93c1-43ea-a357-0d0fb46c34dd with Priority: HIGHEST for action port [ 974.561034] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6836245a-93c1-43ea-a357-0d0fb46c34dd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.561034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6836245a-93c1-43ea-a357-0d0fb46c34dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.561034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6836245a-93c1-43ea-a357-0d0fb46c34dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.561034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6836245a-93c1-43ea-a357-0d0fb46c34dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.561034] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6836245a-93c1-43ea-a357-0d0fb46c34dd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.796463] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.064279] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6836245a-93c1-43ea-a357-0d0fb46c34dd [ 975.064397] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.064509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.064567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.064785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.064843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.064962] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6836245a-93c1-43ea-a357-0d0fb46c34dd already deleted. [ 975.065026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6836245a-93c1-43ea-a357-0d0fb46c34dd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.299206] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.299418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.299418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.299653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.299745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.299850] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 975.337247] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.337247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.337247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.337247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.337247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.348776] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 976.027745] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ed80ad06-b167-4630-b6f2-3bf279cd75dd tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_rules [ 976.028476] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_rules [ 976.028899] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.029083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.029192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.029547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.029668] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.278393] env[65660]: INFO networking_nsxv3.common.synchronization [None req-0d5bd5be-2977-4bdb-b387-f10a3f8963f9 tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_rules [ 976.279215] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_rules [ 976.279285] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.279372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.458944] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 976.459411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.552427] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.552508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.552547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.552759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.552848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.552945] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f already deleted. [ 976.553049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.553256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.553436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.553550] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.076490] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.076657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.076749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.076906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.076992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.077151] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f already deleted. [ 977.077226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.360381] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 977.360505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.360653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.360881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.361089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.361206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.361272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.361531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.361617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.361713] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.704551] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6fd33173-f81a-459b-a912-4bd3189d6731 None None] Enqueued Resource ID: 787ad810-dd2e-4a19-8fcd-79fc6ef53ce8 with Priority: HIGHEST for action port [ 977.705958] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787ad810-dd2e-4a19-8fcd-79fc6ef53ce8 with Priority: HIGHEST for action port [ 977.705958] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-787ad810-dd2e-4a19-8fcd-79fc6ef53ce8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.705958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-787ad810-dd2e-4a19-8fcd-79fc6ef53ce8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.708236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-787ad810-dd2e-4a19-8fcd-79fc6ef53ce8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.708236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-787ad810-dd2e-4a19-8fcd-79fc6ef53ce8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.708236] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('787ad810-dd2e-4a19-8fcd-79fc6ef53ce8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.866057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.866057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.866057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.866057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.866057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.866481] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.866481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.866481] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.866597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.867159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.867159] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 977.881559] env[65660]: INFO networking_nsxv3.common.synchronization [req-c855fd06-92c6-4066-bdc6-605c8fed3ba0 req-8f4eaa3b-7518-4b06-9ef6-c47ec83f74e1 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_members [ 977.882291] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGHEST for action security_group_members [ 977.882679] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.882804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.883691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.883691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.883691] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.883691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.883691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.884115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.884115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.884115] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.900235] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.900235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.900235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.900235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.900235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.912250] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 978.208611] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 787ad810-dd2e-4a19-8fcd-79fc6ef53ce8 [ 978.209415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.209825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.209825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.210856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.210856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.210856] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:787ad810-dd2e-4a19-8fcd-79fc6ef53ce8 already deleted. [ 978.210856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-787ad810-dd2e-4a19-8fcd-79fc6ef53ce8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.389613] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.389613] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.389613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.389613] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 is going to be updated. [ 978.424369] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.424369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.424487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.424693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.424832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.439402] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 in Status: IN_PROGRESS for 2s [ 979.923442] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 979.923720] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb deletion is rescheduled due to dependency. [ 979.923720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.227959] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2b77af73-e161-4eb2-a9b3-6e63b15ac60f None None] Enqueued Resource ID: 860cef07-3732-4004-83e1-965f6d6a0e98 with Priority: HIGHEST for action port [ 980.228596] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 860cef07-3732-4004-83e1-965f6d6a0e98 with Priority: HIGHEST for action port [ 980.228926] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-860cef07-3732-4004-83e1-965f6d6a0e98 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.229076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-860cef07-3732-4004-83e1-965f6d6a0e98" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.229142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-860cef07-3732-4004-83e1-965f6d6a0e98" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.229411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-860cef07-3732-4004-83e1-965f6d6a0e98" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.229499] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860cef07-3732-4004-83e1-965f6d6a0e98',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.451029] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 in Status: SUCCESS [ 980.451242] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 deletion is rescheduled due to dependency. [ 980.451335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.731473] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 860cef07-3732-4004-83e1-965f6d6a0e98 [ 980.731764] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.732243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.732243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.732358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.732358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.732441] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:860cef07-3732-4004-83e1-965f6d6a0e98 already deleted. [ 980.732522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-860cef07-3732-4004-83e1-965f6d6a0e98" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.113691] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5db5a19b-7b90-4a84-aa1e-9dd5b16ec291 None None] Enqueued Resource ID: 3477cbde-24c4-400f-bde7-291b5c8b758f with Priority: HIGHEST for action port [ 982.117570] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3477cbde-24c4-400f-bde7-291b5c8b758f with Priority: HIGHEST for action port [ 982.118495] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3477cbde-24c4-400f-bde7-291b5c8b758f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.118774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3477cbde-24c4-400f-bde7-291b5c8b758f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.118774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3477cbde-24c4-400f-bde7-291b5c8b758f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.119426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3477cbde-24c4-400f-bde7-291b5c8b758f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.119426] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3477cbde-24c4-400f-bde7-291b5c8b758f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.200598] env[65660]: INFO networking_nsxv3.common.synchronization [req-caaa6652-7f93-4a24-8b43-2c8a724136cb req-7bd98882-c71d-40fb-a102-2b85ed537809 tempest-ServersAdminNegativeTestJSON-1347068261 tempest-ServersAdminNegativeTestJSON-1347068261-project-member] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 982.204015] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGHEST for action security_group_members [ 982.204845] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.205057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.205115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.205336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.205859] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.205985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.206061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.206224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.208194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.208381] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.623434] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3477cbde-24c4-400f-bde7-291b5c8b758f [ 982.623434] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.623434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.623434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.623434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.623434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.623434] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3477cbde-24c4-400f-bde7-291b5c8b758f already deleted. [ 982.623434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3477cbde-24c4-400f-bde7-291b5c8b758f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.703767] env[65660]: INFO networking_nsxv3.common.synchronization [None req-e2cc36be-e3a6-4a66-a049-f9f4e59cd892 None None] Enqueued Resource ID: f8dd3cef-dcc4-4579-8248-23b3f74de6e8 with Priority: HIGHEST for action port [ 982.704291] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8dd3cef-dcc4-4579-8248-23b3f74de6e8 with Priority: HIGHEST for action port [ 982.704641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8dd3cef-dcc4-4579-8248-23b3f74de6e8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.704769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8dd3cef-dcc4-4579-8248-23b3f74de6e8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.704837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8dd3cef-dcc4-4579-8248-23b3f74de6e8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.705377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8dd3cef-dcc4-4579-8248-23b3f74de6e8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.705813] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8dd3cef-dcc4-4579-8248-23b3f74de6e8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.711933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.712064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.712359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.712359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.712457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.712618] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.712719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.712784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.712936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.713023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.713543] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be updated. [ 982.746308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.746308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.746308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.746565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.746793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.757454] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: IN_PROGRESS for 2s [ 983.207916] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8dd3cef-dcc4-4579-8248-23b3f74de6e8 [ 983.208360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.208360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.208492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.208601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.208687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.208805] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8dd3cef-dcc4-4579-8248-23b3f74de6e8 already deleted. [ 983.208904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8dd3cef-dcc4-4579-8248-23b3f74de6e8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.320499] env[65660]: INFO networking_nsxv3.common.synchronization [req-33d49cbd-30c2-4d4b-9664-83a1eecc81ff req-1e1d3029-508d-46c4-a444-ab08ba80f522 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 984.321471] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 984.321471] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.321615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.321677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.321856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.323026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.323026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.323174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.324686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.324686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.324686] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.666148] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.666148] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.666148] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.666148] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.666758] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.667187] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.667433] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.667801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.668153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.668545] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.668914] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.671026] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.671026] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.671026] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.671026] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.671026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.691664] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.691836] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.691836] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.692017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.692415] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.692598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.692724] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.693076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.693219] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3669fd89-ed9a-47e2-9b98-fb6c6f587b9c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.768311] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e in Status: SUCCESS [ 984.768501] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e deletion is rescheduled due to dependency. [ 984.768622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.827242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.827392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.827465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.827694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.827786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.828051] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.828134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.828174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.828296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.828372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.828459] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 984.871756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.871756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.871756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.871756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.871756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.900392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 985.196145] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.196409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.196523] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.196866] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.197049] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.197217] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 3669fd89-ed9a-47e2-9b98-fb6c6f587b9c not found, creating... [ 985.197493] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.197648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.197769] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.198041] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.198168] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.198444] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.198617] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.198706] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.199045] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.199159] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.199297] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 3669fd89-ed9a-47e2-9b98-fb6c6f587b9c is going to be created. [ 985.220445] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.220693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.220798] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.221069] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.221347] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.221582] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.948617] env[65660]: INFO networking_nsxv3.common.synchronization [req-33d49cbd-30c2-4d4b-9664-83a1eecc81ff req-981d388a-c7e0-4375-9954-fdf9bed1a80f service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 985.948884] env[65660]: INFO networking_nsxv3.common.synchronization [req-33d49cbd-30c2-4d4b-9664-83a1eecc81ff req-981d388a-c7e0-4375-9954-fdf9bed1a80f service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 985.949011] env[65660]: INFO networking_nsxv3.common.synchronization [req-33d49cbd-30c2-4d4b-9664-83a1eecc81ff req-981d388a-c7e0-4375-9954-fdf9bed1a80f service nova] Enqueued Resource ID: 3669fd89-ed9a-47e2-9b98-fb6c6f587b9c with Priority: HIGHEST for action port [ 985.949595] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 985.949761] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 985.949875] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3669fd89-ed9a-47e2-9b98-fb6c6f587b9c with Priority: HIGHEST for action port [ 985.950324] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.950494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.950568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.950839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.950908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.951999] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.952198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.952435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.952624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.952624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.952805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.952947] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3669fd89-ed9a-47e2-9b98-fb6c6f587b9c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.456723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.456723] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3669fd89-ed9a-47e2-9b98-fb6c6f587b9c with status ACTIVE [ 986.456723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.456723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.456723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.459273] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.459273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.459273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.459273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.459273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.459273] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3669fd89-ed9a-47e2-9b98-fb6c6f587b9c is going to be updated. [ 986.480227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.480457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.480457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.481172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.481172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.481172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3669fd89-ed9a-47e2-9b98-fb6c6f587b9c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.914189] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 986.914189] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.914189] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.914189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.914189] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.416477] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.925529] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.433369] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.433798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.433798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.434145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.434145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.434252] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 988.472703] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.473012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.473086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.473280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.473439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.484318] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 990.251654] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ac46d118-51bf-40b7-b931-39f263f21562 tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 with Priority: HIGHEST for action security_group_rules [ 990.252493] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 with Priority: HIGHEST for action security_group_rules [ 990.252733] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.252857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.252921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.253396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.253396] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de25e90d-fb4b-4183-aa6a-0dd0bcb7f509',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.393753] env[65660]: INFO networking_nsxv3.common.synchronization [None req-208c0281-2723-4830-8fcf-805124af8c20 tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 with Priority: HIGHEST for action security_group_rules [ 990.395243] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 with Priority: HIGHEST for action security_group_rules [ 990.396034] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.396034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.508606] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.508606] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.508606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.508606] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.685641] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a3b0187-c676-41c5-adac-46adcdd57438 req-4fae2d0b-126f-443e-b39b-29a6f7f14393 tempest-ImagesTestJSON-1980635674 tempest-ImagesTestJSON-1980635674-project-member] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 990.686470] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGHEST for action security_group_members [ 990.686800] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.686924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.686999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.687208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.687365] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.687478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.687513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.687652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.687773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.687816] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.773868] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.774027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.774098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.774327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.774418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.774513] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 already deleted. [ 990.774609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.774732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.774881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.774958] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de25e90d-fb4b-4183-aa6a-0dd0bcb7f509',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.010996] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.011583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.011583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.011583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.011887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.011887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.011887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.012220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.012220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.012220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.012313] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.012363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.012428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.012574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.012734] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.012833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.012887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.013045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.013125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.013203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.013307] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.189873] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.190059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.190533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.190533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.190533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.190783] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.190854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.190921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.191070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.191143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.191228] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be updated. [ 991.222038] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.222231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.222348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.222651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.222846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.233062] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: IN_PROGRESS for 2s [ 991.300138] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.300138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.300138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.300138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.300138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.300138] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de25e90d-fb4b-4183-aa6a-0dd0bcb7f509 already deleted. [ 991.300601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de25e90d-fb4b-4183-aa6a-0dd0bcb7f509" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.519500] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2663bd-4c5a-4280-b2b0-ccd214332642: rpc.has_security_group_logging(os_id): False [ 991.538572] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.538791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.538895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.539230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.539341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.539838] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.539979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.540079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.540307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.540401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.540631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.540998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.541090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.541234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.542840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.542840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.542840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.542840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.542840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.542840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.542840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 991.620513] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.620513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.620513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.621655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.621655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.646447] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 993.192420] env[65660]: INFO networking_nsxv3.common.synchronization [req-f5b1ff52-2e76-4dc3-ab90-2310e8da807a req-9f280d9e-b1df-4046-ae84-2510f5dd242b tempest-ServersV294TestFqdnHostnames-1957478415 tempest-ServersV294TestFqdnHostnames-1957478415-project-member] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_members [ 993.193015] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_members [ 993.193776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.194067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.194067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.194860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.194860] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.194860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.194860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.195056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.195056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.195146] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.251736] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 335a6866-6ca7-4c63-a411-59c67e151de0 in Status: SUCCESS [ 993.251967] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 deletion is rescheduled due to dependency. [ 993.252053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.637847] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.638061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-42" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.638186] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-42" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.638510] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-42" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.638770] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.638962] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.639100] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.639314] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.639505] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.639747] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.639863] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.639972] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.640095] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.640196] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.640301] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.640434] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.663219] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 993.663591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.666471] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.667359] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.667359] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.667359] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-42" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.667533] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-b76745ca-f017-4970-bad5-b9ae6c9320f5 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.668357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.668357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.668357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.668757] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76745ca-f017-4970-bad5-b9ae6c9320f5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.698367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.698609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.698671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.699426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.699524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.699728] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.701015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.701015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.701015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.701015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.701015] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 already deleted. [ 993.701015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.870863] env[65660]: INFO networking_nsxv3.common.synchronization [req-81a778e6-e77b-42b9-8610-09ebdd4d85d7 req-63316e35-a134-4045-8c61-21386132204d tempest-MigrationsAdminTest-1938599151 tempest-MigrationsAdminTest-1938599151-project-member] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 993.871115] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 993.871622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.871693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.871759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.871960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.872120] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.872281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.872281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.873026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.873026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.873026] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.172646] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.172786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.172916] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.173253] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.173408] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.173572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port b76745ca-f017-4970-bad5-b9ae6c9320f5 not found, creating... [ 994.173826] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.173988] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.174130] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.174400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.174547] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.174855] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.175019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.175157] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.175383] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.175517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.175656] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: b76745ca-f017-4970-bad5-b9ae6c9320f5 is going to be created. [ 994.196225] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.196523] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.196606] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.196892] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.197180] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.197405] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.376902] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.548488] env[65660]: INFO networking_nsxv3.common.synchronization [req-635ecdb6-c960-4306-930d-c56b59298230 req-f65c3fea-03dd-4181-ad9b-84b301360790 tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 994.549237] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 994.549780] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.549780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.549917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.550205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.550398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.550519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.550599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.550862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.550962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.551129] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.880292] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.902257] env[65660]: INFO networking_nsxv3.common.synchronization [req-f5b1ff52-2e76-4dc3-ab90-2310e8da807a req-a7623118-0a74-4f61-8c06-504d2850e58c service nova] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_rules [ 994.902257] env[65660]: INFO networking_nsxv3.common.synchronization [req-f5b1ff52-2e76-4dc3-ab90-2310e8da807a req-a7623118-0a74-4f61-8c06-504d2850e58c service nova] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_members [ 994.902393] env[65660]: INFO networking_nsxv3.common.synchronization [req-f5b1ff52-2e76-4dc3-ab90-2310e8da807a req-a7623118-0a74-4f61-8c06-504d2850e58c service nova] Enqueued Resource ID: b76745ca-f017-4970-bad5-b9ae6c9320f5 with Priority: HIGHEST for action port [ 994.902979] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_rules [ 994.902979] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_members [ 994.905184] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b76745ca-f017-4970-bad5-b9ae6c9320f5 with Priority: HIGHEST for action port [ 994.905184] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.905184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.905184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.905612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.905857] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.906938] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.907201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.907775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.907775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.907775] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.908036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.908036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.908036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.908137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.908171] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.909862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b76745ca-f017-4970-bad5-b9ae6c9320f5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.909862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.909862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.909862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.909862] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b76745ca-f017-4970-bad5-b9ae6c9320f5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.934967] env[65660]: INFO networking_nsxv3.common.synchronization [req-14a7a437-3ee2-4ee3-ac06-e969fc5826e4 req-e4212c7a-0f35-488c-8821-23f6bade5828 tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_members [ 994.935603] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGHEST for action security_group_members [ 994.936212] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.939882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.939971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.940208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.941121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.941121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.941121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.941281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.941281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.941382] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.054306] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.054604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.054679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.054990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.055123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.055381] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.055533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.055586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.056762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.056762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.056762] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 995.086855] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.087041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.087084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.087297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.087443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.097056] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 995.388712] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.389093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.389569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.389901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.390013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.390130] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be updated. [ 995.412212] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.413257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.413257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.413257] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b76745ca-f017-4970-bad5-b9ae6c9320f5 with status ACTIVE [ 995.414023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.414023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.414235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.415025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.415025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.415025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.415025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.415364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.415364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.415441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.415614] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.415711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.415776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.415926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.416024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.416113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b76745ca-f017-4970-bad5-b9ae6c9320f5 is going to be updated. [ 995.431422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.431617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.431984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.431984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.432164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.442327] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: IN_PROGRESS for 2s [ 995.443297] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.443546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.443546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.443704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.443753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.443943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b76745ca-f017-4970-bad5-b9ae6c9320f5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.448889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.449064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.449145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.449347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.449508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.451177] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.451274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.451379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.451531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.451618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.451712] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e is going to be updated. [ 995.515258] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.515448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.515616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.515881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.516174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.539980] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f07331b-fa4c-4bef-bffd-f4749900380e in Status: IN_PROGRESS for 2s [ 995.918768] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.421887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.422364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.422364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.422609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.422877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.422877] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 is going to be created. [ 996.455283] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.455484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.455555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.455756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.455914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.467546] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: UNINITIALIZED for 2s [ 996.568125] env[65660]: INFO networking_nsxv3.common.synchronization [None req-244e70c3-4d5e-441a-b71a-9eff12af9653 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 996.569050] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 996.569563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.569706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.569797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.570371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.570499] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.733025] env[65660]: INFO networking_nsxv3.common.synchronization [None req-aa3c680c-090c-483f-909d-e6ddd686ee19 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 996.733424] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 996.733925] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.733925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.090981] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.091192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.091192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.091448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.091533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.091630] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4557e9-9a44-4482-869f-e690653fe59e already deleted. [ 997.091705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.091871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.092068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.092170] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.108036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 997.108233] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 997.108233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.123870] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c7b38f6f-1e17-4238-868f-1d87918c3d4e None None] Enqueued Resource ID: a28587b5-5adf-440c-ac91-a083ea209733 with Priority: HIGHEST for action port [ 997.125452] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28587b5-5adf-440c-ac91-a083ea209733 with Priority: HIGHEST for action port [ 997.125452] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a28587b5-5adf-440c-ac91-a083ea209733 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.125452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a28587b5-5adf-440c-ac91-a083ea209733" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.125707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a28587b5-5adf-440c-ac91-a083ea209733" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.126327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a28587b5-5adf-440c-ac91-a083ea209733" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.126327] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a28587b5-5adf-440c-ac91-a083ea209733',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.455428] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 997.455781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.553435] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f07331b-fa4c-4bef-bffd-f4749900380e in Status: SUCCESS [ 997.553435] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e deletion is rescheduled due to dependency. [ 997.553435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.613842] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.613842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.613955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.614212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.614333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.614434] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4557e9-9a44-4482-869f-e690653fe59e already deleted. [ 997.614543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.629263] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a28587b5-5adf-440c-ac91-a083ea209733 [ 997.629556] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.629758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.629882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.630205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.630265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.630424] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a28587b5-5adf-440c-ac91-a083ea209733 already deleted. [ 997.630591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a28587b5-5adf-440c-ac91-a083ea209733" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.488562] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: SUCCESS [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.488562] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.488562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.488562] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.530870] env[65660]: INFO networking_nsxv3.common.synchronization [req-46baf0cc-ca95-4c61-b4e5-a8357a51a30f req-89b506a5-2d2c-477f-8b47-cf03f3176f6d tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_members [ 998.531637] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_members [ 998.531839] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.532332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.532332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.532332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.532544] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.532677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.532970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.532970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.533109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.533109] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.620475] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2f88530a-5798-4830-8668-a03d2a7a2552 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_rules [ 998.621102] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_rules [ 998.621459] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.621601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.621740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.621986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.622194] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.750430] env[65660]: INFO networking_nsxv3.common.synchronization [None req-2c5f88b5-1056-49ec-9503-9a713bd94d08 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_rules [ 998.751047] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_rules [ 998.751375] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.751472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.954147] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.954413] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.954559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.954844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.955142] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.955358] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.955549] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.955792] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.956044] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.956312] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.956474] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.956556] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.956659] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.956769] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.956886] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.957030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.978118] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.978303] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.978467] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.978686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.979075] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.979371] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.979462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.979800] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.980188] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.989165] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.036081] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.036248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.036322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.036591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.036700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.036874] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.036977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.037056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.037252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.037324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.037564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f already deleted. [ 999.037564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.146549] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.146718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.146870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.147107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.147274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.147412] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 already deleted. [ 999.147521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.147727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.147976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.149252] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.402062] env[65660]: INFO networking_nsxv3.common.synchronization [None req-9010efd3-7f6a-4041-b3cf-b8ea388d75d3 None None] Enqueued Resource ID: 10e19d99-a058-4536-8fec-cc2d9aed9e7d with Priority: HIGHEST for action port [ 999.402933] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e19d99-a058-4536-8fec-cc2d9aed9e7d with Priority: HIGHEST for action port [ 999.403286] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-10e19d99-a058-4536-8fec-cc2d9aed9e7d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.403423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10e19d99-a058-4536-8fec-cc2d9aed9e7d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.403789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10e19d99-a058-4536-8fec-cc2d9aed9e7d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.403789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10e19d99-a058-4536-8fec-cc2d9aed9e7d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.403789] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10e19d99-a058-4536-8fec-cc2d9aed9e7d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.482670] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.482996] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.483458] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.483458] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.483600] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.483730] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb not found, creating... [ 999.483992] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.484256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.484502] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.484961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.484961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.485392] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.485555] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.485696] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.485932] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.486112] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.486285] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb is going to be created. [ 999.494265] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaaf560a-6fd3-465d-97f1-23540c20f1b1: rpc.has_security_group_logging(os_id): False [ 999.515189] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.515366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.515657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.515814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.515814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.516321] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.516321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.516321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.516442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.516519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.516581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 is going to be created. [ 999.518734] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.518923] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.519076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.519394] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.519541] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.519770] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.591525] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.591796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.591878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.592261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.592414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.608212] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: IN_PROGRESS for 2s [ 999.696533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.696740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.696820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.697084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.697360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.697491] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 already deleted. [ 999.697567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.906326] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10e19d99-a058-4536-8fec-cc2d9aed9e7d [ 999.906696] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.906909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.907081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.907335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.907465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.907656] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10e19d99-a058-4536-8fec-cc2d9aed9e7d already deleted. [ 999.907851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10e19d99-a058-4536-8fec-cc2d9aed9e7d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.264746] env[65660]: INFO networking_nsxv3.common.synchronization [req-46baf0cc-ca95-4c61-b4e5-a8357a51a30f req-5e9f943f-6ae8-45be-ace6-f16f879cf9b4 service nova] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_rules [ 1000.264746] env[65660]: INFO networking_nsxv3.common.synchronization [req-46baf0cc-ca95-4c61-b4e5-a8357a51a30f req-5e9f943f-6ae8-45be-ace6-f16f879cf9b4 service nova] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_members [ 1000.264746] env[65660]: INFO networking_nsxv3.common.synchronization [req-46baf0cc-ca95-4c61-b4e5-a8357a51a30f req-5e9f943f-6ae8-45be-ace6-f16f879cf9b4 service nova] Enqueued Resource ID: 4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb with Priority: HIGHEST for action port [ 1000.265765] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_rules [ 1000.265765] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_members [ 1000.265765] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb with Priority: HIGHEST for action port [ 1000.265989] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.270880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.270880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.270880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.270880] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.270880] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.270880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.271439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.271439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.271496] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.271697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.271754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.272479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.272479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.272479] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.276499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.276626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.277899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.277899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.277899] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.778953] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.780232] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.780325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.780540] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb with status ACTIVE [ 1000.780990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.780990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.780990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.781525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.781525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.781622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.781673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.781820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.781969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.786162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.786849] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.786849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.786849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.786849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.787022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.787056] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb is going to be updated. [ 1000.810527] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.810759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.810759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.811035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.811201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.811458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf3e29b-590c-4ae4-9a9d-8a9c57b649bb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.958668] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ad3343-91ed-4d49-aa9b-3185152c26bc req-20956f2e-ee8d-422e-b894-114cab8af6ff tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1000.959242] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1000.959516] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.959641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.959708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.959970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.960139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.960236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.960339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.960452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.960535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.960629] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.290069] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.444995] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.445244] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.445376] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.445716] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.446614] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.446831] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.446991] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.447406] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.447610] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.447845] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.448093] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.448220] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.448362] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.448501] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.448711] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.448924] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.463566] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.466797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.466992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.467267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.467366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.467692] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.467821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.467880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.468070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.468175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.468272] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c already deleted. [ 1001.468358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.470328] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.470497] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.470686] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.470884] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.471278] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-127d606e-93fb-4793-a0a9-ada3edde4900 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.471553] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.471715] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.472366] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.472366] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('127d606e-93fb-4793-a0a9-ada3edde4900',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.621036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: SUCCESS [ 1001.621464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.794740] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.794740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.795049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.795049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.795107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.795381] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f is going to be created. [ 1001.819100] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.819270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.819341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.819603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.819770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.829383] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: UNINITIALIZED for 2s [ 1001.974783] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.975048] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.975186] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.975635] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.975803] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.975964] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 127d606e-93fb-4793-a0a9-ada3edde4900 not found, creating... [ 1001.976240] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.976404] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.976541] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.976780] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.976917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.977217] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.977435] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.977577] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.977793] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.977929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.978082] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 127d606e-93fb-4793-a0a9-ada3edde4900 is going to be created. [ 1002.003405] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.003618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.004143] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.004143] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.004394] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.004798] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.710176] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ad3343-91ed-4d49-aa9b-3185152c26bc req-015795de-734d-431a-8d96-9d33c96f4aa7 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1002.710359] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ad3343-91ed-4d49-aa9b-3185152c26bc req-015795de-734d-431a-8d96-9d33c96f4aa7 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1002.710526] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0ad3343-91ed-4d49-aa9b-3185152c26bc req-015795de-734d-431a-8d96-9d33c96f4aa7 service nova] Enqueued Resource ID: 127d606e-93fb-4793-a0a9-ada3edde4900 with Priority: HIGHEST for action port [ 1002.711036] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1002.711144] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1002.711235] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 127d606e-93fb-4793-a0a9-ada3edde4900 with Priority: HIGHEST for action port [ 1002.711998] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.712190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.712262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.712487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.712660] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.713605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.713993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.713993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.713993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.714109] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.714253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.714318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.715216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.715216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.715216] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.715469] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-127d606e-93fb-4793-a0a9-ada3edde4900 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.715560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.715620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.715776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.715845] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('127d606e-93fb-4793-a0a9-ada3edde4900',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.218031] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.219246] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.219246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.219614] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 127d606e-93fb-4793-a0a9-ada3edde4900 with status ACTIVE [ 1003.219798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.219907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.219971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.220182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.220272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.220499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.220611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.220682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.220851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.220926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.221121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.221215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.221299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.221514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.221514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.221572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 127d606e-93fb-4793-a0a9-ada3edde4900 is going to be updated. [ 1003.249257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.249405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.249485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.249681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.249819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.249977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-127d606e-93fb-4793-a0a9-ada3edde4900" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.542191] env[65660]: INFO networking_nsxv3.common.synchronization [req-3aecba22-ea87-4868-9959-bd3be0242ce2 req-12e93496-1e35-4e86-83f5-620bd7176bb8 tempest-FloatingIPsAssociationTestJSON-885564246 tempest-FloatingIPsAssociationTestJSON-885564246-project-member] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1003.542765] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1003.543077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.543203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.543265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.543498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.543733] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.543733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.543830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.543927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.544015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.544280] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.720890] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.829698] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.829973] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.830169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.830807] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.830977] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.831234] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.831413] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.831815] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.832031] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.833028] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.833028] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.833028] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.833028] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.833028] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.833258] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.833363] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.845383] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: SUCCESS [ 1003.845680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.845895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.846195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.846461] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.846620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.846710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.846935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.847046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.847156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.847282] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.855669] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.855901] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.856104] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.856347] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.856768] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-ab48f182-7f7b-43a8-abae-0d436ac89143 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.857069] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.857203] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.857618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.857811] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab48f182-7f7b-43a8-abae-0d436ac89143',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.046164] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.046345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.046443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.046628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.046718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.046918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.047098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.047098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.047235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.047310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.048045] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 already deleted. [ 1004.048192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.222631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.222941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.222941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.223089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.223141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.223238] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be created. [ 1004.249439] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.249706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.249803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.250055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.250255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.259804] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: UNINITIALIZED for 2s [ 1004.350146] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.360824] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.361256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.361457] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.362178] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.362178] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.362400] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port ab48f182-7f7b-43a8-abae-0d436ac89143 not found, creating... [ 1004.362835] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.363120] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.363344] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.363786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.364061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.365067] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.365360] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.365584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.365941] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.366486] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.366749] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: ab48f182-7f7b-43a8-abae-0d436ac89143 is going to be created. [ 1004.394750] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.395023] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.395330] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.395776] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.396065] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.396334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.852883] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f: rpc.has_security_group_logging(os_id): False [ 1004.873752] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.873921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.873990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.874271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.874391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.874713] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.874713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.874833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.874972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.875068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.875189] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f is going to be created. [ 1004.951139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.951139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.951534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.951760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.967099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: IN_PROGRESS for 2s [ 1005.199689] env[65660]: INFO networking_nsxv3.common.synchronization [req-3aecba22-ea87-4868-9959-bd3be0242ce2 req-6a847f16-40e7-4199-9cae-00ca219800ff service nova] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_rules [ 1005.199878] env[65660]: INFO networking_nsxv3.common.synchronization [req-3aecba22-ea87-4868-9959-bd3be0242ce2 req-6a847f16-40e7-4199-9cae-00ca219800ff service nova] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1005.200031] env[65660]: INFO networking_nsxv3.common.synchronization [req-3aecba22-ea87-4868-9959-bd3be0242ce2 req-6a847f16-40e7-4199-9cae-00ca219800ff service nova] Enqueued Resource ID: ab48f182-7f7b-43a8-abae-0d436ac89143 with Priority: HIGHEST for action port [ 1005.200592] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_rules [ 1005.200719] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1005.200842] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab48f182-7f7b-43a8-abae-0d436ac89143 with Priority: HIGHEST for action port [ 1005.201298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.201509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.201577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.202401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.202401] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.203827] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.203827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.203827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.203827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.203827] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.204225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.204225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.204225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.204340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.204553] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.205338] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab48f182-7f7b-43a8-abae-0d436ac89143 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.205455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.205562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.205682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.205763] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab48f182-7f7b-43a8-abae-0d436ac89143',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.707961] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab48f182-7f7b-43a8-abae-0d436ac89143 with status ACTIVE [ 1005.708214] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.708398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.708462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.708626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.708715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.708898] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.708997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.709076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.709226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.709304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.709478] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.709572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.709650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.709890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.709981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.710112] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab48f182-7f7b-43a8-abae-0d436ac89143 is going to be updated. [ 1005.711316] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.712391] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.712391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.736579] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.736728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.736797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.737015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.737160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.737323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab48f182-7f7b-43a8-abae-0d436ac89143" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.213582] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.272038] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1006.273498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.273735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.273990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.274238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.274348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.274416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.274581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.274666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.274754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.275036] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.718320] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.718320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.718320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.718320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.718320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.718320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be created. [ 1006.740364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.740364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.740584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.740700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.740866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.751425] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: UNINITIALIZED for 2s [ 1006.777229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.777441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.777533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.777982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.777982] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.778130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.778130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.778315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.778421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.778549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.778676] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.778761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.778838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.779067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.779217] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.779388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.779388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.779551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.779630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.779717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.779846] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.981543] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: SUCCESS [ 1006.981949] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.282320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1007.310887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.311297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.311297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.311427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.311427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.311673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.311872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.311872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.312306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.312306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.312462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.312515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.312609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.312740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.312805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.313209] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.313314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.313378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.313980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.313980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.313980] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be created. [ 1007.398094] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.398094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.398094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.398094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.398094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.408478] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1008.771854] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1008.772400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.772400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.773392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.773392] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.773392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.773392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.773392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.773392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.773392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.773826] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.067274] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6ddc3f26-82cd-4408-be78-b39cd658732a None None] Enqueued Resource ID: 1fc42ed6-19be-4376-b6bc-773caa4a83ca with Priority: HIGHEST for action port [ 1009.067907] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fc42ed6-19be-4376-b6bc-773caa4a83ca with Priority: HIGHEST for action port [ 1009.068470] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fc42ed6-19be-4376-b6bc-773caa4a83ca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.069186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fc42ed6-19be-4376-b6bc-773caa4a83ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.069186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fc42ed6-19be-4376-b6bc-773caa4a83ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.069186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fc42ed6-19be-4376-b6bc-773caa4a83ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.069186] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fc42ed6-19be-4376-b6bc-773caa4a83ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.275583] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.275813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.276166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.276203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.276652] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.276652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.276791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.276947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.277007] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.277112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.277311] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.277468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.277468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.277719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.278514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.278514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.278514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.278514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.278514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.278514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.278876] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.427564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1009.427890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.572533] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fc42ed6-19be-4376-b6bc-773caa4a83ca [ 1009.572798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.572965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.573365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.573365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.573365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.573540] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fc42ed6-19be-4376-b6bc-773caa4a83ca already deleted. [ 1009.573612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fc42ed6-19be-4376-b6bc-773caa4a83ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.782902] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4: rpc.has_security_group_logging(os_id): False [ 1009.804294] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.804539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.804539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.804757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.804842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.805077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.805846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.805846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.805846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.805846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.805846] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.805846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.805846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.806349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.806349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.806349] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.806349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.806572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.806572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.806646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.806739] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be created. [ 1009.884305] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.884558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.884628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.884852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.885642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.898662] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: IN_PROGRESS for 2s [ 1010.660907] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1010.661099] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:2 started [ 1011.913623] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1011.914104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.993734] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d1fb4a10-2f03-4147-a787-1f8fda55bcfe None None] Enqueued Resource ID: f6f5fd12-9089-4c96-99d3-37ce0a3ba661 with Priority: HIGHEST for action port [ 1011.994534] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f5fd12-9089-4c96-99d3-37ce0a3ba661 with Priority: HIGHEST for action port [ 1011.994962] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f5fd12-9089-4c96-99d3-37ce0a3ba661 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.996480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f5fd12-9089-4c96-99d3-37ce0a3ba661" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.996551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f5fd12-9089-4c96-99d3-37ce0a3ba661" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.996922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f5fd12-9089-4c96-99d3-37ce0a3ba661" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.997105] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f5fd12-9089-4c96-99d3-37ce0a3ba661',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.384502] env[65660]: INFO networking_nsxv3.common.synchronization [req-25378b34-5011-46be-bf62-931870433607 req-d1b358d1-a902-4a0c-b13e-ea7c4ce19249 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1012.385087] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1012.385452] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.385585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.385674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.385886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.386059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.386159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.386229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.386382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.386480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.386575] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.501852] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6f5fd12-9089-4c96-99d3-37ce0a3ba661 [ 1012.502160] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.502811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.502811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.502811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.502983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.502983] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6f5fd12-9089-4c96-99d3-37ce0a3ba661 already deleted. [ 1012.503282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f5fd12-9089-4c96-99d3-37ce0a3ba661" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.890048] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.890048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.890048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.890048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.890396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.890513] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.890709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.890819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.891132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.891307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.891467] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1012.924673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.924673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.924673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.925173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.925173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.936697] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1013.366704] env[65660]: INFO networking_nsxv3.common.synchronization [None req-62424389-9ec2-4411-a291-4e790a9184df tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_rules [ 1013.367194] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_rules [ 1013.367577] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.367647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.367711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.367988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.368506] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.633966] env[65660]: INFO networking_nsxv3.common.synchronization [None req-6f143d0a-3b58-4a36-a1cb-0e8c88369b21 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_rules [ 1013.635859] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_rules [ 1013.635859] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.636353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.895354] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.895538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.895604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.895850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.895957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.896067] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 already deleted. [ 1013.896154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.896745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.896925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.897104] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.418441] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.418786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.418786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.418875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.418909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.419086] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 already deleted. [ 1014.419086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.947552] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1014.947741] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1014.947871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.645160] env[65660]: INFO networking_nsxv3.common.synchronization [req-1b2170d9-bedb-4e18-9b1e-10807f22c8c9 req-612595b3-3b8a-4c28-b356-40c98250644d tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1015.645819] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1015.646135] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.646258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.646356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.646520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.646967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.647089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.647155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.647318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.647407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.647496] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.952771] env[65660]: INFO networking_nsxv3.common.synchronization [None req-5c31a04e-0698-4ecc-ab41-89a26233a7d6 None None] Enqueued Resource ID: 3bb0d8b5-cfcd-4cdc-8b40-45bae1685449 with Priority: HIGHEST for action port [ 1015.953535] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb0d8b5-cfcd-4cdc-8b40-45bae1685449 with Priority: HIGHEST for action port [ 1015.954416] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bb0d8b5-cfcd-4cdc-8b40-45bae1685449 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.954714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bb0d8b5-cfcd-4cdc-8b40-45bae1685449" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.954808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bb0d8b5-cfcd-4cdc-8b40-45bae1685449" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.955099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bb0d8b5-cfcd-4cdc-8b40-45bae1685449" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.955212] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bb0d8b5-cfcd-4cdc-8b40-45bae1685449',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.071491] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.071491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.071491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.071491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.071491] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.071491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.071491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.071952] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.071952] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.072091] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.072275] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.072414] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.073024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.073024] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.073024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.073200] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.094982] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.095197] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.095439] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.095554] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.095857] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-ee895a83-eaff-41c9-9945-dc466a5c5182 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.096050] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.096184] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.096548] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.096695] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee895a83-eaff-41c9-9945-dc466a5c5182',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.149359] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.149536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.149603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.149896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.150055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.150292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.150402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.150462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.150624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.150701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.150785] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1016.175430] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.175601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.175675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.175903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.176062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.185242] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1016.460388] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3bb0d8b5-cfcd-4cdc-8b40-45bae1685449 [ 1016.460743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.460879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.460976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.461618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.461618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.461618] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3bb0d8b5-cfcd-4cdc-8b40-45bae1685449 already deleted. [ 1016.461618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bb0d8b5-cfcd-4cdc-8b40-45bae1685449" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.599063] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.599223] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.599223] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.599489] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.599630] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.599779] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port ee895a83-eaff-41c9-9945-dc466a5c5182 not found, creating... [ 1016.601961] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.601961] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.601961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.602393] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: ee895a83-eaff-41c9-9945-dc466a5c5182 is going to be created. [ 1016.628397] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.628643] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.628760] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.629018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.629275] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.629508] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.509777] env[65660]: INFO networking_nsxv3.common.synchronization [req-1b2170d9-bedb-4e18-9b1e-10807f22c8c9 req-e93f56c0-e173-4133-83db-2bcc4286a67b service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 1017.510235] env[65660]: INFO networking_nsxv3.common.synchronization [req-1b2170d9-bedb-4e18-9b1e-10807f22c8c9 req-e93f56c0-e173-4133-83db-2bcc4286a67b service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1017.510235] env[65660]: INFO networking_nsxv3.common.synchronization [req-1b2170d9-bedb-4e18-9b1e-10807f22c8c9 req-e93f56c0-e173-4133-83db-2bcc4286a67b service nova] Enqueued Resource ID: ee895a83-eaff-41c9-9945-dc466a5c5182 with Priority: HIGHEST for action port [ 1017.510683] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 1017.510824] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1017.511030] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee895a83-eaff-41c9-9945-dc466a5c5182 with Priority: HIGHEST for action port [ 1017.511416] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.514177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.514311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.514528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.514618] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.515655] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.515800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.515983] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee895a83-eaff-41c9-9945-dc466a5c5182 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.516196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.516196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.516397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.516464] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee895a83-eaff-41c9-9945-dc466a5c5182',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.021895] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.021895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.021895] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee895a83-eaff-41c9-9945-dc466a5c5182 with status ACTIVE [ 1018.022644] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.022644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.022644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.022644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.022816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.025431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.025431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.025431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.025431] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee895a83-eaff-41c9-9945-dc466a5c5182 is going to be updated. [ 1018.056704] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.056898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.056898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.057161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.058754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.058754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee895a83-eaff-41c9-9945-dc466a5c5182" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.068951] env[65660]: INFO networking_nsxv3.common.synchronization [req-1d0c35d3-025a-4090-b944-d2a72dae0833 req-af48ccdb-2cf5-45c6-be70-cb21374b9722 tempest-MigrationsAdminTest-1938599151 tempest-MigrationsAdminTest-1938599151-project-member] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 1018.070287] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGHEST for action security_group_members [ 1018.070715] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.071928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.071928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.072096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.072280] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.072414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.072480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.072662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.072744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.072850] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.204326] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1018.204608] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 1018.204789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.206167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.206409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.206719] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.206902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.206997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.207184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.207265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.207656] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.576019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.576444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.576444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.576953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.576953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.577176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.577372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.577460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.577713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.577863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.578050] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be updated. [ 1018.617127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.617366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.617366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.617683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.617848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.628146] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: IN_PROGRESS for 2s [ 1018.710239] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.896641] env[65660]: INFO networking_nsxv3.common.synchronization [None req-1acd32f9-3bfd-4588-8698-0dc90f09becf None None] Enqueued Resource ID: 7ce8afb9-fc87-409c-a2e4-b68eea949a96 with Priority: HIGHEST for action port [ 1018.896641] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ce8afb9-fc87-409c-a2e4-b68eea949a96 with Priority: HIGHEST for action port [ 1018.896641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ce8afb9-fc87-409c-a2e4-b68eea949a96 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.896641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ce8afb9-fc87-409c-a2e4-b68eea949a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.896641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ce8afb9-fc87-409c-a2e4-b68eea949a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.896641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ce8afb9-fc87-409c-a2e4-b68eea949a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.896641] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ce8afb9-fc87-409c-a2e4-b68eea949a96',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.212862] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.398696] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ce8afb9-fc87-409c-a2e4-b68eea949a96 [ 1019.399076] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.399256] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.399347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.399600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.399698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.399829] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ce8afb9-fc87-409c-a2e4-b68eea949a96 already deleted. [ 1019.399975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ce8afb9-fc87-409c-a2e4-b68eea949a96" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.715948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.716513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.716513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.716513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.716513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.716745] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1019.758502] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.758775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.758775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.759041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.759182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.776687] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1019.987734] env[65660]: INFO networking_nsxv3.common.synchronization [req-a2a1e370-663f-4872-b8ff-dc43b512cb07 req-f3672f6f-931a-4ad9-9c7b-be96c3f779a5 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1019.988277] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1019.988588] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.988709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.988768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.989057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.989493] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.989633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.989700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.989864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.989952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.990061] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.354525] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.354525] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.354525] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.354792] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.354991] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.355183] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.355300] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.355577] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.355747] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.356029] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.356157] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.356268] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.356374] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.356485] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.356590] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.356750] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.379896] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.380150] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.380268] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.380449] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.380771] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-27a64d88-842a-47fb-beee-0ecc3dd213f4 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.381067] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.381067] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.381638] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.381638] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27a64d88-842a-47fb-beee-0ecc3dd213f4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.492710] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.494217] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.494217] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e already deleted. [ 1020.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.640115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 in Status: SUCCESS [ 1020.640303] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 deletion is rescheduled due to dependency. [ 1020.640415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.884798] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.885544] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.885777] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.886213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.886466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.886681] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 27a64d88-842a-47fb-beee-0ecc3dd213f4 not found, creating... [ 1020.887061] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.887316] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.887480] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.887812] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.887992] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.888424] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.888641] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.888790] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.889387] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.889639] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.889882] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 27a64d88-842a-47fb-beee-0ecc3dd213f4 is going to be created. [ 1020.912502] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.912824] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.912978] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.913355] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.913631] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.913955] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.703126] env[65660]: INFO networking_nsxv3.common.synchronization [req-a2a1e370-663f-4872-b8ff-dc43b512cb07 req-a85c755f-1b57-4452-8630-5633a13a643a service nova] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 1021.705122] env[65660]: INFO networking_nsxv3.common.synchronization [req-a2a1e370-663f-4872-b8ff-dc43b512cb07 req-a85c755f-1b57-4452-8630-5633a13a643a service nova] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1021.705122] env[65660]: INFO networking_nsxv3.common.synchronization [req-a2a1e370-663f-4872-b8ff-dc43b512cb07 req-a85c755f-1b57-4452-8630-5633a13a643a service nova] Enqueued Resource ID: 27a64d88-842a-47fb-beee-0ecc3dd213f4 with Priority: HIGHEST for action port [ 1021.705122] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 1021.705122] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1021.705122] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a64d88-842a-47fb-beee-0ecc3dd213f4 with Priority: HIGHEST for action port [ 1021.705122] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.705636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.705636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.705636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.705636] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.706371] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.706475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.706540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.706746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.706904] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.707008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.707077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.707237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.707324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.707409] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.708200] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-27a64d88-842a-47fb-beee-0ecc3dd213f4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.708303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.708365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.708526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.708591] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27a64d88-842a-47fb-beee-0ecc3dd213f4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.790148] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1021.790377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.790565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.790812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.791035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.791192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.791286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.791461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.791518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.791591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.791718] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.210420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.210737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.210786] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.212938] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27a64d88-842a-47fb-beee-0ecc3dd213f4 with status ACTIVE [ 1022.214032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.214032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.214032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.214032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.214032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.214312] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.214312] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.214440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.214577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.214750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.214886] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.215056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.215112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.215387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.215387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.215491] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27a64d88-842a-47fb-beee-0ecc3dd213f4 is going to be updated. [ 1022.239137] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.239325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.239369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.239574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.240145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.240145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27a64d88-842a-47fb-beee-0ecc3dd213f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.294622] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.294622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.294622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.295023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.295023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.295152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.295187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.295864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.295864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.295864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.295864] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.295864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.295864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.296170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.296170] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.296281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.296281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.296412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.296490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.296570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.296693] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.718231] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.801293] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e872372-e4f2-43b5-922d-ee045d8baf5b: rpc.has_security_group_logging(os_id): False [ 1022.902718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.902988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.902988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.903209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.903285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.903494] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.903638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.903676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.903830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.903954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.904098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.904498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.904626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.905224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.905224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.905224] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.905392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.905433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.905987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.905987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.905987] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1022.980714] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.980837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.980934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.981167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.981330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.000553] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1023.220570] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.220894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.220894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.221102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.221241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.221369] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be created. [ 1023.248206] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.248394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.248474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.248730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.248990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.261245] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: UNINITIALIZED for 2s [ 1025.018622] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1025.018948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.092397] env[65660]: INFO networking_nsxv3.common.synchronization [req-01be7ff7-5874-426d-8b3b-6976982e277c req-2f95170d-490d-4fce-b2d6-d5d9efd9f0ed tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 1025.093034] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 1025.093298] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.093501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.093588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.094584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.094584] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.094797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.094797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.095360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.095360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.095360] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.270910] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1025.271590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.271590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.271746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.271867] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.272025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.272085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.272228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.272308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.272405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.272537] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.598223] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.599997] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.600139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.600193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.600472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.600543] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.775584] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.100587] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.102775] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.277586] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de4557e9-9a44-4482-869f-e690653fe59e: rpc.has_security_group_logging(os_id): False [ 1026.305651] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.305651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.305651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.306129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.306129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.306250] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.306337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.306400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.306563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.306629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.306729] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be created. [ 1026.388576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.388816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.388924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.389165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.389361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.404968] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: IN_PROGRESS for 2s [ 1026.603350] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.603642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.603642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.603804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.603950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.604038] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be updated. [ 1026.605492] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.645685] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.645955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.646917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.646917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.646917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.659693] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: IN_PROGRESS for 2s [ 1027.107847] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1027.108153] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1027.338194] env[65660]: INFO networking_nsxv3.common.synchronization [req-6d50d015-bea5-4a60-a81c-d581bdb6b8b9 req-52d81b19-b2e9-4fd4-9979-ed44a0ddfdd1 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_members [ 1027.338600] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_members [ 1027.339119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.339415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.339591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.339941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.340253] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.340485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.340661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.340938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.341134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.341310] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.699546] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-220 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.699546] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.699546] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.699546] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.699871] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.700090] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.700229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.700531] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.700773] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.701022] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.701141] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.701249] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.701360] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.701576] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.701609] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.701733] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.726392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.726631] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.726777] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.726954] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.727425] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-025ffd52-b265-4890-90d5-36907bcd2608 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.727619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.727741] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.728077] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.728217] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('025ffd52-b265-4890-90d5-36907bcd2608',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.845379] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.845603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.845680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.845911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.846022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.846247] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.846359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.846424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.846588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.846663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.846813] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 already deleted. [ 1027.846927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.014814] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.014998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.015067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.015727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.026711] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1028.030069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.031254] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1028.068350] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.068563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.068563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.068778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.080587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.081218] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1028.081298] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1028.081383] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1028.139454] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.139759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.139759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.139863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.141428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.141613] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1028.232021] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.232483] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.232715] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.233164] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.233409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.233663] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 025ffd52-b265-4890-90d5-36907bcd2608 not found, creating... [ 1028.234095] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.234352] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.234715] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.235074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.235206] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.235655] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.235758] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.235904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.236157] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.236323] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.236515] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 025ffd52-b265-4890-90d5-36907bcd2608 is going to be created. [ 1028.277433] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.277671] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.277763] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.278061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.278291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.278536] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.293425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.293586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.293586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.293753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.294063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.294344] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1028.423573] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1028.423882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.481970] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.482214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.482214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.482434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.482770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.483113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1028.483213] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8c31855b-36a6-4c63-86d7-83465075aed8', 'dd660da0-3553-4221-8c8e-0723ad648c55', '762d0913-cb8b-4e75-8dd8-3320e4790403', '1bb1aae9-5e28-4517-b1d1-0a8a052663cb', 'df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa', 'eaef59ac-b94f-47d8-8852-ec864d2e9eeb', 'a4849bc3-c5eb-4d2a-b87d-61a1b4e18236', '9ea6f6a9-d971-4d60-9de9-fb59a5a466c5', '5f07331b-fa4c-4bef-bffd-f4749900380e', 'aaaf560a-6fd3-465d-97f1-23540c20f1b1', '4e872372-e4f2-43b5-922d-ee045d8baf5b', '5bf0f4a4-4808-4a1d-a832-54c26e813f60', 'b604088e-8278-4c35-a94f-fc57fbebf7a4', '2604d13b-747f-46b6-934c-17fb07504709', '335a6866-6ca7-4c63-a411-59c67e151de0', '4cecee2b-3b4b-4faf-a5cb-ce4521ea583f', '39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82', '384c91ff-3865-47c2-b54a-ade5d4bb5f41', '5075ffdb-26d9-4c45-8f12-db06f5a52322', 'db90b51b-f35c-42cc-8ed2-59a87f10bd43', 'cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a', 'da44bcac-8dcd-43ae-b931-eee44940a29b', '1dbcba73-4b06-4756-bd56-81b58777d093', '4a06f441-5f17-4ab5-b491-331edf1151db', '3402fe38-bb82-4e23-ab22-23f54a22de87', '0a8aaa9b-7467-48c3-bfb1-e630aeec084c', 'f6705170-58ac-456b-99c6-9d36829cfeca', 'a30035af-7284-45ea-aa1f-a189cf5311fc', 'de4557e9-9a44-4482-869f-e690653fe59e', 'ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4', 'f149ebe9-de13-482c-885e-b787b9881cd4', '6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80', 'ef75b626-5ac5-4f1b-bccb-30d1c66c9174', '0a105954-38cf-4ea3-9175-f0a7478feadd', '575bfa27-1492-4754-bbae-fa15d2d40215', '86e61356-708b-403e-ad42-c5f9a1dc7099', 'cad2f7bd-5440-41f4-8c8a-0a54a291c118', '5546cce7-b8e5-406f-8abd-1541b01097c9', 'a92ae96e-10c4-4e29-8e7f-609600f2de2e', '9b2663bd-4c5a-4280-b2b0-ccd214332642', '9acb2cb2-9e67-4059-8899-02421dd18f5c', '527845fc-1b66-4f17-85ee-b1fc80f19f8e', 'e668c0d3-6bc9-4aa1-941b-9707aedef834', 'dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a', '775da0ad-e96e-41a5-a2df-bf309e71cba6', 'e152fef8-1030-4523-b8a3-d71ee61ec9e1', '225b293b-1569-42d6-87b8-ea54b1fed92d'} {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1028.483321] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1028.507817] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.508298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.508298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.508483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.508629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.508901] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1028.508901] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1028.509129] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1028.621509] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.621694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.621743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.621924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.622912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.623284] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1028.623412] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1028.623559] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1028.623663] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1028.623763] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1028.623838] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGH for action security_group_rules [ 1028.623915] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGH for action security_group_rules [ 1028.623982] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGH for action security_group_rules [ 1028.624100] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGH for action security_group_rules [ 1028.624301] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGH for action security_group_rules [ 1028.624301] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGH for action security_group_rules [ 1028.624396] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGH for action security_group_rules [ 1028.624396] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGH for action security_group_rules [ 1028.624497] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGH for action security_group_rules [ 1028.624497] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGH for action security_group_rules [ 1028.624595] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGH for action security_group_rules [ 1028.624636] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGH for action security_group_rules [ 1028.624695] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGH for action security_group_rules [ 1028.624755] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGH for action security_group_rules [ 1028.624853] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGH for action security_group_rules [ 1028.624945] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGH for action security_group_rules [ 1028.625035] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGH for action security_group_rules [ 1028.625118] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGH for action security_group_rules [ 1028.625192] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGH for action security_group_rules [ 1028.625256] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGH for action security_group_rules [ 1028.625359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.672330] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 1028.672330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.976326] env[65660]: INFO networking_nsxv3.common.synchronization [req-6d50d015-bea5-4a60-a81c-d581bdb6b8b9 req-afaa538d-f9a7-4627-b0d1-7785a48da3bc service nova] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_rules [ 1028.976472] env[65660]: INFO networking_nsxv3.common.synchronization [req-6d50d015-bea5-4a60-a81c-d581bdb6b8b9 req-afaa538d-f9a7-4627-b0d1-7785a48da3bc service nova] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_members [ 1028.976472] env[65660]: INFO networking_nsxv3.common.synchronization [req-6d50d015-bea5-4a60-a81c-d581bdb6b8b9 req-afaa538d-f9a7-4627-b0d1-7785a48da3bc service nova] Enqueued Resource ID: 025ffd52-b265-4890-90d5-36907bcd2608 with Priority: HIGHEST for action port [ 1028.977050] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_members [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025ffd52-b265-4890-90d5-36907bcd2608 with Priority: HIGHEST for action port [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c31855b-36a6-4c63-86d7-83465075aed8 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335a6866-6ca7-4c63-a411-59c67e151de0 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 with Priority: HIGH for action security_group_rules [ 1028.978262] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGH for action security_group_rules [ 1028.978685] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGH for action security_group_rules [ 1028.978685] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGH for action security_group_rules [ 1028.978685] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 with Priority: HIGH for action security_group_rules [ 1028.978777] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGH for action security_group_rules [ 1028.978870] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGH for action security_group_rules [ 1028.978923] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f07331b-fa4c-4bef-bffd-f4749900380e with Priority: HIGH for action security_group_rules [ 1028.979164] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGH for action security_group_rules [ 1028.979164] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 with Priority: HIGH for action security_group_rules [ 1028.979164] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa with Priority: HIGH for action security_group_rules [ 1028.979360] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd660da0-3553-4221-8c8e-0723ad648c55 with Priority: HIGH for action security_group_rules [ 1028.979360] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb with Priority: HIGH for action security_group_rules [ 1028.979624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.979746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.979810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.980040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.980267] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.984030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.984030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.984030] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.984030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-025ffd52-b265-4890-90d5-36907bcd2608 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.984030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.984030] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('025ffd52-b265-4890-90d5-36907bcd2608',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.984866] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c31855b-36a6-4c63-86d7-83465075aed8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.984962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.985133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.985372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.985484] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c31855b-36a6-4c63-86d7-83465075aed8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.986453] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d0913-cb8b-4e75-8dd8-3320e4790403 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.986604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.986749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.987129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.987129] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d0913-cb8b-4e75-8dd8-3320e4790403',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.989360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.989360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.989360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.989360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.989360] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4849bc3-c5eb-4d2a-b87d-61a1b4e18236',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.990210] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-335a6866-6ca7-4c63-a411-59c67e151de0 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.990279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.990334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.990874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.990874] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('335a6866-6ca7-4c63-a411-59c67e151de0',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.991790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.992383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.992383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.992383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.992610] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db90b51b-f35c-42cc-8ed2-59a87f10bd43',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.996021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5075ffdb-26d9-4c45-8f12-db06f5a52322 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.996021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.996021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.996021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.996021] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5075ffdb-26d9-4c45-8f12-db06f5a52322',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.996021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.996021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.996021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.996946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.996946] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384c91ff-3865-47c2-b54a-ade5d4bb5f41',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.997460] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.997600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.997649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.997884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.998036] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.999121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.999315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.999666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.999869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.001074] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.001544] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.001634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.002182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.002593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.002724] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.004886] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.005064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.005157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.005499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.005565] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.006795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.006914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.007338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.007338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.007462] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf0f4a4-4808-4a1d-a832-54c26e813f60',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.008548] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.008745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.008872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.009120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.009220] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.010539] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.010720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.011590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.011590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.011590] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.012594] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f07331b-fa4c-4bef-bffd-f4749900380e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.012770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.012860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.016378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.016378] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f07331b-fa4c-4bef-bffd-f4749900380e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.016378] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.016378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.016378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.016378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.016378] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.016378] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.016378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.016378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.016937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.016937] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ea6f6a9-d971-4d60-9de9-fb59a5a466c5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.018488] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.018488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.018488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.018488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.018488] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.020352] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd660da0-3553-4221-8c8e-0723ad648c55 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.020352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.020352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.020352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.020352] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd660da0-3553-4221-8c8e-0723ad648c55',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.021596] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.021596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.021596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.021596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.021596] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb1aae9-5e28-4517-b1d1-0a8a052663cb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.049136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.051141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.051141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.051141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.075752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.075944] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 335a6866-6ca7-4c63-a411-59c67e151de0 is going to be deleted. [ 1029.134948] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.135203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.135203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.135306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.135353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.135459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-335a6866-6ca7-4c63-a411-59c67e151de0" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.524763] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.525212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.525212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.525343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.525569] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.525678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.525732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.525884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.525971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.526856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.526856] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.527295] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.531402] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 025ffd52-b265-4890-90d5-36907bcd2608 with status ACTIVE [ 1029.531402] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.531402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.531402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.531402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.531402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.531840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.531840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.531840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.531840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.531980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.532178] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.532329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.532437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.532681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.532807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.532903] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 025ffd52-b265-4890-90d5-36907bcd2608 is going to be updated. [ 1029.533967] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.534144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.534197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.534321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.534525] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.534616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.534683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.534829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.534906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.534987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.535222] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.541964] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.555878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.556075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.556347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.556485] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.556572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.556832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.556933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.557032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.557132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.557819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.557819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.557819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.557819] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.558582] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.558582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.558680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.559262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.559262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.559262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.559262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.559450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.559450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.559529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.559626] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.569588] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.569730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.569730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.569951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.570052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.570161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 is going to be created. [ 1029.612856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.613043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.613157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.613352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.619605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.619801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.621255] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.621397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.624442] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.624604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.625461] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.625623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.627054] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.627177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.628167] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.628167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.628892] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.629025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.629849] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.629947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.630705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.630854] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.635655] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.635772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.636518] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.637127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.637268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.643128] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.643690] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.643892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.644820] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.645392] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.645509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.646451] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.647042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.647215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.647282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.647501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.647658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.649211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.649328] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82 is going to be deleted. [ 1029.650124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.650308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.651815] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.651932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.651999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.652171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.652291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.652440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-025ffd52-b265-4890-90d5-36907bcd2608" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.653746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.653838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.665989] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.666442] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51e4307b-44db-4d05-8640-bb1b3523e887 in Status: UNINITIALIZED for 2s [ 1029.674527] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.675106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.675246] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db90b51b-f35c-42cc-8ed2-59a87f10bd43 is going to be deleted. [ 1029.676535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.676776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.711132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.711308] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c31855b-36a6-4c63-86d7-83465075aed8 is going to be deleted. [ 1029.712231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.712844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.716290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.716449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.771918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.771918] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f07331b-fa4c-4bef-bffd-f4749900380e is going to be deleted. [ 1029.772600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.772831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.794150] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.794150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.831808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.832026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be deleted. [ 1029.833502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.833867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.856941] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.857078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.889714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.889842] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ea6f6a9-d971-4d60-9de9-fb59a5a466c5 is going to be deleted. [ 1029.890765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.890981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.919981] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.920153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.935574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.935780] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf0f4a4-4808-4a1d-a832-54c26e813f60 is going to be deleted. [ 1029.937318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.937507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.939141] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.939275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.969169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.969169] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384c91ff-3865-47c2-b54a-ade5d4bb5f41 is going to be deleted. [ 1029.969948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.970477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.043101] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.046270] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.067535] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.068032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.068032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.068032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.068246] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.068394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.068472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.068630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.068738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.068831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.068949] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.069056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.069120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.069253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.069390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.069476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.069538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.069695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.069805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.069893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.070059] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.072467] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.096914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.097114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd660da0-3553-4221-8c8e-0723ad648c55 is going to be deleted. [ 1030.098594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.098831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.101176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.101335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.106317] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.106506] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.156236] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.158086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.174816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.175090] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa is going to be deleted. [ 1030.176024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.180440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.244391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.244708] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb1aae9-5e28-4517-b1d1-0a8a052663cb is going to be deleted. [ 1030.245910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.246173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.318160] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.318440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.336896] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.337071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.363434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.363620] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4849bc3-c5eb-4d2a-b87d-61a1b4e18236 is going to be deleted. [ 1030.365609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.366830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.406270] env[65660]: INFO networking_nsxv3.common.synchronization [req-0922be7f-6450-41e4-98a1-30117bb1edc0 req-5550a9d1-c339-4b3e-a2e8-9f2bcd0459d0 tempest-ImagesOneServerTestJSON-2060300439 tempest-ImagesOneServerTestJSON-2060300439-project-member] Enqueued Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_members [ 1030.406787] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_members [ 1030.406968] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.407123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.407196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.407508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.407615] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.407720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.407777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.407933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.408066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.408179] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.410016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.410144] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d0913-cb8b-4e75-8dd8-3320e4790403 is going to be deleted. [ 1030.411443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.411631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.462670] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.462670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.470027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.470027] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5075ffdb-26d9-4c45-8f12-db06f5a52322 is going to be deleted. [ 1030.470027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.470027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.538129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.538460] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be deleted. [ 1030.539227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.539458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.539552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.539677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a39a91-0e1d-4efe-b69b-b2b5bc5ecd82" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.541089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.541329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.541386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.541514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db90b51b-f35c-42cc-8ed2-59a87f10bd43" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.542084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.542263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.542348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.542527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c31855b-36a6-4c63-86d7-83465075aed8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.542729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.542971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.543052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.543171] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f07331b-fa4c-4bef-bffd-f4749900380e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.543299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.543448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.543534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.543649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.543778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.543919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.544023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.545018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ea6f6a9-d971-4d60-9de9-fb59a5a466c5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.545247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.545531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.545531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.545658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf0f4a4-4808-4a1d-a832-54c26e813f60" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.545748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.545946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.546089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.546254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384c91ff-3865-47c2-b54a-ade5d4bb5f41" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.546412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.546642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.546918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.547081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd660da0-3553-4221-8c8e-0723ad648c55" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.547321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.547458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.547540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.547679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df99e807-c2c3-4eb6-ba3a-bd2616e5cbaa" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.548116] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f: rpc.has_security_group_logging(os_id): False [ 1030.549275] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2604d13b-747f-46b6-934c-17fb07504709: rpc.has_security_group_logging(os_id): False [ 1030.550743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.551172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.551318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.551465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb1aae9-5e28-4517-b1d1-0a8a052663cb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.571396] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.571642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.571642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.571794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.571843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.571986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4849bc3-c5eb-4d2a-b87d-61a1b4e18236" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.573434] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e872372-e4f2-43b5-922d-ee045d8baf5b: rpc.has_security_group_logging(os_id): False [ 1030.575526] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaaf560a-6fd3-465d-97f1-23540c20f1b1: rpc.has_security_group_logging(os_id): False [ 1030.593325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.593587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.593587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.593771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.593875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.593992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5075ffdb-26d9-4c45-8f12-db06f5a52322" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.603435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.603652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.603747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.603977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.618098] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.618396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.624315] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.624536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.629319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.629462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.659431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.659691] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.659796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.659856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.660123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.660221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.660480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.660480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.660624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.660699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.660764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.660980] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.661087] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.661149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.661305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.661384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.661491] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1030.662926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.663285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.664846] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.664944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.685524] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.685635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.695815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.696901] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.696901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.696901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.697267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.697267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.697890] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f is going to be updated. [ 1030.698980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.699366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.740271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.740393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.740465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.740538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.741055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.741055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.741055] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1030.743430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.743978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.743978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.743978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d0913-cb8b-4e75-8dd8-3320e4790403" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.743978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.744204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.744204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.745122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.745122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.745122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.775846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.775846] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.775846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.775846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.775846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.775846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.775846] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 is going to be updated. [ 1030.805453] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.805628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.807044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.807044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.807044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.817567] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.817757] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-998" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.817886] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-998" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.818365] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-998" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.819596] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.820292] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.820292] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.820449] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.820779] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.822357] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.822536] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.822704] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.822914] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.823085] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.823207] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.823350] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.844401] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.844624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.845469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.845469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.845469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.859376] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1030.859376] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.859609] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.859666] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.860056] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-998" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.860306] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-dc3bff07-904e-4f1f-b40b-02acae4865ac taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.860754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.860754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.861309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.861309] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc3bff07-904e-4f1f-b40b-02acae4865ac',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.883078] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: IN_PROGRESS for 2s [ 1030.898375] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.898375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.898375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.898375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.898375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.915028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.915028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.915028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.915028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.915028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.915413] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.915413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.915413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.915665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.915665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.915756] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 already deleted. [ 1030.915806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.925908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1030.946692] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.946692] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.946692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.946692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.946692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.946692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.985633] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: IN_PROGRESS for 2s [ 1031.365151] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.365425] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.365599] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.365920] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.366243] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.366319] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port dc3bff07-904e-4f1f-b40b-02acae4865ac not found, creating... [ 1031.366522] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.366688] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.366837] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.367097] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.367246] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.367537] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.367695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.367811] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.368456] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.368648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.368804] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: dc3bff07-904e-4f1f-b40b-02acae4865ac is going to be created. [ 1031.410058] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.412026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.412026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.412026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.412026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.412026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.677370] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51e4307b-44db-4d05-8640-bb1b3523e887 in Status: SUCCESS [ 1031.677723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.677951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.678193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.678633] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.678633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.678784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.678984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.679074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.679184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.679302] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.069122] env[65660]: INFO networking_nsxv3.common.synchronization [req-0922be7f-6450-41e4-98a1-30117bb1edc0 req-2780bc3f-8e2b-4364-8584-53946fa9675d service nova] Enqueued Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_rules [ 1032.070361] env[65660]: INFO networking_nsxv3.common.synchronization [req-0922be7f-6450-41e4-98a1-30117bb1edc0 req-2780bc3f-8e2b-4364-8584-53946fa9675d service nova] Enqueued Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_members [ 1032.070361] env[65660]: INFO networking_nsxv3.common.synchronization [req-0922be7f-6450-41e4-98a1-30117bb1edc0 req-2780bc3f-8e2b-4364-8584-53946fa9675d service nova] Enqueued Resource ID: dc3bff07-904e-4f1f-b40b-02acae4865ac with Priority: HIGHEST for action port [ 1032.070361] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_rules [ 1032.070593] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_members [ 1032.070712] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc3bff07-904e-4f1f-b40b-02acae4865ac with Priority: HIGHEST for action port [ 1032.071196] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.071196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.071196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.072429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.072429] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.072671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.072827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.072923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.073177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.076208] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.076208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.076321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.077488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.077488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.077488] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.078443] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc3bff07-904e-4f1f-b40b-02acae4865ac taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.079409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.079552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.079803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.079907] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc3bff07-904e-4f1f-b40b-02acae4865ac',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.182725] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.567510] env[65660]: INFO networking_nsxv3.common.synchronization [req-f9f99253-2827-40b4-a003-77fdbae992ab req-a28b20a3-f691-4116-9d7c-9233cbe6bda9 tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1032.567754] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1032.568239] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.568239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.568405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.568445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.568601] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.569591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.569591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.569591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.569591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.569591] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.587204] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.587204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.587204] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.587204] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc3bff07-904e-4f1f-b40b-02acae4865ac with status ACTIVE [ 1032.587204] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.587204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.590184] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.590184] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.590184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.590184] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc3bff07-904e-4f1f-b40b-02acae4865ac is going to be updated. [ 1032.618492] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.619155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.619155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.619155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.619155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.619376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc3bff07-904e-4f1f-b40b-02acae4865ac" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.686099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51e4307b-44db-4d05-8640-bb1b3523e887: rpc.has_security_group_logging(os_id): False [ 1032.707028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.707174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.707294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.707495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.707588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.707910] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.708073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.708141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.708320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.708434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.708530] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 is going to be created. [ 1032.812641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.812806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.812806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.814184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.814184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.841987] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51e4307b-44db-4d05-8640-bb1b3523e887 in Status: IN_PROGRESS for 2s [ 1032.877096] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1032.877096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.921800] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: SUCCESS [ 1032.921800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.944908] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1032.944908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.000515] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: SUCCESS [ 1033.000691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.003568] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.003926] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.004218] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.004637] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.004951] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.005210] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.005362] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.005646] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.005843] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.006254] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.006425] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.006571] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.006734] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.006892] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.007024] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.008063] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.027322] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.027529] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.027696] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.027878] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.028253] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-2cf9426f-7f81-4db5-8b83-1e6040d038c4 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.028452] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.028664] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.028938] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.030720] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf9426f-7f81-4db5-8b83-1e6040d038c4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.073411] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.093517] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.533379] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.533968] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.534400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.534957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.535301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.536206] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 2cf9426f-7f81-4db5-8b83-1e6040d038c4 not found, creating... [ 1033.536796] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.537066] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.537232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.537592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.537914] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.538302] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.538516] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.538731] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.539236] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.539355] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.539587] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 2cf9426f-7f81-4db5-8b83-1e6040d038c4 is going to be created. [ 1033.565557] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.565892] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.566034] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.566269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.566510] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.566758] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.576977] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.597449] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.597667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.597751] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.597932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.598049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.598192] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 is going to be created. [ 1033.630318] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.630536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.630587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.630838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.631029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.653389] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 in Status: UNINITIALIZED for 2s [ 1034.080032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.080032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.080032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.080507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.080507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.081104] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1034.120558] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.120728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.120796] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.122086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.122086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.144823] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1034.386121] env[65660]: INFO networking_nsxv3.common.synchronization [req-f9f99253-2827-40b4-a003-77fdbae992ab req-bf255c0d-6a48-4353-8a07-e070ba6d4b44 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1034.387110] env[65660]: INFO networking_nsxv3.common.synchronization [req-f9f99253-2827-40b4-a003-77fdbae992ab req-bf255c0d-6a48-4353-8a07-e070ba6d4b44 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1034.388061] env[65660]: INFO networking_nsxv3.common.synchronization [req-f9f99253-2827-40b4-a003-77fdbae992ab req-bf255c0d-6a48-4353-8a07-e070ba6d4b44 service nova] Enqueued Resource ID: 2cf9426f-7f81-4db5-8b83-1e6040d038c4 with Priority: HIGHEST for action port [ 1034.390376] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1034.390572] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1034.390692] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf9426f-7f81-4db5-8b83-1e6040d038c4 with Priority: HIGHEST for action port [ 1034.391015] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.391143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.391268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.391436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.391518] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.392929] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.393091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.393334] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cf9426f-7f81-4db5-8b83-1e6040d038c4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.393474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.393569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.393850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.394017] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf9426f-7f81-4db5-8b83-1e6040d038c4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.858593] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51e4307b-44db-4d05-8640-bb1b3523e887 in Status: SUCCESS [ 1034.858774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.900022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.900022] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cf9426f-7f81-4db5-8b83-1e6040d038c4 with status ACTIVE [ 1034.900022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.900022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.900022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.900022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.900615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.900615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.900615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.900615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.900615] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cf9426f-7f81-4db5-8b83-1e6040d038c4 is going to be updated. [ 1034.924580] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.924778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.924778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.925279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.925279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.925397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cf9426f-7f81-4db5-8b83-1e6040d038c4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.019618] env[65660]: INFO networking_nsxv3.common.synchronization [req-e60147d9-cc90-4d3d-9fc8-d404b969dfdf req-8fd32205-12bf-43e8-9dc9-e04e1f02551a tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_members [ 1035.020609] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_members [ 1035.020752] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.020909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.020994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.021472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.021637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.021772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.021813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.022092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.022176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.022567] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.416124] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.416586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.416586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.416586] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.417638] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.417817] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.417957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.418242] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.418390] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.418610] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.418723] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.418830] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.418959] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.419080] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.419187] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.419318] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.439449] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.439620] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.439796] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.439999] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.440320] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.440574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.440719] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.441096] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.442041] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ee4edb4-34ff-4cbb-b590-f0a657a72d77',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.524701] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.524920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.525024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.525337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.525499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.525544] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.525656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.525721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.525881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.526034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.526103] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 already deleted. [ 1035.526150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.664694] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 in Status: SUCCESS [ 1035.664921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.665112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.665337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.665586] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.665732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.665732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.665907] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.665988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666190] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.944408] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.944683] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.944822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.945178] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.945267] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.945404] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 5ee4edb4-34ff-4cbb-b590-f0a657a72d77 not found, creating... [ 1035.945686] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.945912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.945987] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.946201] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.946339] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.946619] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.946775] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.946894] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.947211] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.947380] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.947525] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 5ee4edb4-34ff-4cbb-b590-f0a657a72d77 is going to be created. [ 1035.968466] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.968847] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.969104] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.969429] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.969599] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.969800] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.155748] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1036.156443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.156689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.156927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.157130] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.157251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.157309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.157466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.157546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.157644] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.169818] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.170090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.170147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.170324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.170517] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.170647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.170731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.170954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.171057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.171147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.171335] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.171434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.171491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.171633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.171789] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.171981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.171981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.172129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.172263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.172353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.172445] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.659902] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.675030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9415ceef-7d41-4ca8-9473-e649728f53f9: rpc.has_security_group_logging(os_id): False [ 1036.696808] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.697083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.697170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.697430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.697543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.697785] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.698160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.698160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.698268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.698301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.698548] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.698693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.698732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.700581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.700581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.700581] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.700581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.700581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.700581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.700581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.700581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 is going to be created. [ 1036.754812] env[65660]: INFO networking_nsxv3.common.synchronization [req-e60147d9-cc90-4d3d-9fc8-d404b969dfdf req-db6beb0e-f996-490f-a1ae-180da4c4bd59 service nova] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_rules [ 1036.754812] env[65660]: INFO networking_nsxv3.common.synchronization [req-e60147d9-cc90-4d3d-9fc8-d404b969dfdf req-db6beb0e-f996-490f-a1ae-180da4c4bd59 service nova] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_members [ 1036.754812] env[65660]: INFO networking_nsxv3.common.synchronization [req-e60147d9-cc90-4d3d-9fc8-d404b969dfdf req-db6beb0e-f996-490f-a1ae-180da4c4bd59 service nova] Enqueued Resource ID: 5ee4edb4-34ff-4cbb-b590-f0a657a72d77 with Priority: HIGHEST for action port [ 1036.755746] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_rules [ 1036.755985] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_members [ 1036.756210] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee4edb4-34ff-4cbb-b590-f0a657a72d77 with Priority: HIGHEST for action port [ 1036.757547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.757547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.757547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.757547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.757547] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.759947] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.760109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.760219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.761191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.761191] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.761191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.761191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.761191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.761191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.761191] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.763116] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.763116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.763116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.763116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.763408] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ee4edb4-34ff-4cbb-b590-f0a657a72d77',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.788057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.788344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.788344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.788765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.789062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.802038] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 in Status: IN_PROGRESS for 2s [ 1037.162953] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.265736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.266922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.266922] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ee4edb4-34ff-4cbb-b590-f0a657a72d77 with status ACTIVE [ 1037.266922] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.266922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.266922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.266922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.267417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.267417] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.267417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.267536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.267834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.267834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.267957] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.271307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.271307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.271307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.271307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.271307] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ee4edb4-34ff-4cbb-b590-f0a657a72d77 is going to be updated. [ 1037.271307] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.295097] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.295327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.295327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.295449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.295812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.296031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ee4edb4-34ff-4cbb-b590-f0a657a72d77" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.539381] env[65660]: INFO networking_nsxv3.common.synchronization [req-da2c046a-35da-4743-abbd-fc7b1ce64748 req-5278e3b2-c912-4bc2-950c-6b15fb3150f7 tempest-ServerMetadataNegativeTestJSON-867914049 tempest-ServerMetadataNegativeTestJSON-867914049-project-member] Enqueued Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_members [ 1037.540018] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_members [ 1037.540382] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.540509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.540582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.540855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.541031] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.541130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.541185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.541342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.543683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.543683] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.669080] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.669463] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.669463] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.669463] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.669595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.669595] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1037.699555] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.699759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.699832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.700198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.700306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.713536] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1037.772168] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.869110] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.869392] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.869525] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.869929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.870223] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.870385] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.870491] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.870713] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.870856] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.871069] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.871181] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.871289] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.871395] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.871502] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.871606] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.871759] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.892436] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.892637] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.892827] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.892950] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-78" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.893395] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-21e7bb1a-1af0-461a-a640-d9f4247882f1 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.893583] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.893710] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.894070] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.894589] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e7bb1a-1af0-461a-a640-d9f4247882f1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.046902] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.047145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.047238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.047415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.047524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.047705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.047820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.047867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.048071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.048155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.048231] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 already deleted. [ 1038.048311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.274606] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.274920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.274920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.275158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.275254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.275361] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 is going to be created. [ 1038.325117] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.325444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.325444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.325657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.325975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.345114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb72a34f-bda3-4818-a17c-194f6b875921 in Status: UNINITIALIZED for 2s [ 1038.397117] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.397464] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.397650] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.398078] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.398369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.398581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 21e7bb1a-1af0-461a-a640-d9f4247882f1 not found, creating... [ 1038.398937] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.399273] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.399364] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.399631] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.399859] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.400404] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.400662] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.400887] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.401176] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.401326] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.401569] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 21e7bb1a-1af0-461a-a640-d9f4247882f1 is going to be created. [ 1038.446308] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.446308] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.446308] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.446308] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.446811] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.447109] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.820915] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 in Status: SUCCESS [ 1038.820915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.238050] env[65660]: INFO networking_nsxv3.common.synchronization [req-da2c046a-35da-4743-abbd-fc7b1ce64748 req-fd843f9b-58ef-426d-89d8-c0058a476fdc service nova] Enqueued Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_rules [ 1039.238050] env[65660]: INFO networking_nsxv3.common.synchronization [req-da2c046a-35da-4743-abbd-fc7b1ce64748 req-fd843f9b-58ef-426d-89d8-c0058a476fdc service nova] Enqueued Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_members [ 1039.238050] env[65660]: INFO networking_nsxv3.common.synchronization [req-da2c046a-35da-4743-abbd-fc7b1ce64748 req-fd843f9b-58ef-426d-89d8-c0058a476fdc service nova] Enqueued Resource ID: 21e7bb1a-1af0-461a-a640-d9f4247882f1 with Priority: HIGHEST for action port [ 1039.238230] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_rules [ 1039.238399] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_members [ 1039.238559] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e7bb1a-1af0-461a-a640-d9f4247882f1 with Priority: HIGHEST for action port [ 1039.238903] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.239056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.239128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.239400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.239485] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.240455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.240605] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.240676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.240856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.241088] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.241208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.241320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.242048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.242215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.242262] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.246144] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e7bb1a-1af0-461a-a640-d9f4247882f1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.246144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.246144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.246144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.246144] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e7bb1a-1af0-461a-a640-d9f4247882f1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.725246] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1039.725246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.725246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.725503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.725600] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.725706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.725767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.725920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.725994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.726097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.726336] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.745712] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.746960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.746960] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.747810] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e7bb1a-1af0-461a-a640-d9f4247882f1 with status ACTIVE [ 1039.748250] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.748250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.748403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.751309] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.751309] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.751309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.751309] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e7bb1a-1af0-461a-a640-d9f4247882f1 is going to be updated. [ 1039.777829] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.777829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.777829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.777829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.777829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.777829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e7bb1a-1af0-461a-a640-d9f4247882f1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.228533] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.228813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.228813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.229009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.229150] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.229252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.229308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.229461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.229545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.229633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.229779] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.229870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.229937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.230173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.230342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.230436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.232749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.232749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.232749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.232749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.232749] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.253805] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.356667] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb72a34f-bda3-4818-a17c-194f6b875921 in Status: SUCCESS [ 1040.356667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.356667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.357035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.357861] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.357861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.357861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.357861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.357861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.359391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.359391] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.733011] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1040.752774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.752774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.752774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.753050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.757310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.757461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.757605] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.757740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.757876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.757931] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 is going to be created. [ 1040.777978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.778266] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.778386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.778454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.778736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.778736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.779114] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.779273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.779344] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.779510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.779584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.779797] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.779893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.779933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.780159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.780241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.780328] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1040.792678] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.792678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.792678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.792678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.792678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.815699] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 in Status: UNINITIALIZED for 2s [ 1040.864182] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.907536] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.907536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.907915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.907915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.908080] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.925643] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1040.938916] env[65660]: INFO networking_nsxv3.common.synchronization [None req-12388e53-ec59-46ca-b5aa-5482c4e716c8 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_rules [ 1040.939651] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_rules [ 1040.939978] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.940127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.940201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.940448] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.940534] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.035359] env[65660]: INFO networking_nsxv3.common.synchronization [None req-e9de47ad-7c1c-4886-9d5a-da96470d4b01 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_rules [ 1041.035872] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_rules [ 1041.036273] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.036381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.366513] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb72a34f-bda3-4818-a17c-194f6b875921: rpc.has_security_group_logging(os_id): False [ 1041.396474] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.396474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.396706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.397365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.397365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.397365] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.397686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.397686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.397794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.397857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.398415] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 is going to be created. [ 1041.463543] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.463543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.463543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.463543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.463543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.463543] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 332826ee-e169-4398-8162-f86ad56e690d already deleted. [ 1041.463543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.464343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.464343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.464343] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.535166] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.535341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.535491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.535772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.535898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.550504] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb72a34f-bda3-4818-a17c-194f6b875921 in Status: IN_PROGRESS for 2s [ 1041.995797] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.996321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.996484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.996867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996974] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 332826ee-e169-4398-8162-f86ad56e690d already deleted. [ 1041.997074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.085447] env[65660]: INFO networking_nsxv3.common.synchronization [req-2e81b6c0-3219-4a56-9c2e-4c99355bb01d req-ed801189-55d5-4cb2-a3f3-ae97bd47be3f tempest-FloatingIPsAssociationTestJSON-885564246 tempest-FloatingIPsAssociationTestJSON-885564246-project-member] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1042.085447] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1042.085947] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.086813] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.086813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.087158] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.591035] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.592796] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.592989] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.593131] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.593453] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.594036] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.594036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.594264] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.594619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.594619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.594839] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.595106] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.595288] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.595396] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.595547] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.595669] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.595969] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.620382] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.620716] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.620871] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.621044] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-831" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.621458] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-0a60f510-2ec8-4974-b0cb-2d671102c335 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.621720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.621970] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.622511] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.622888] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a60f510-2ec8-4974-b0cb-2d671102c335',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.828714] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 in Status: SUCCESS [ 1042.829201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.829201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.829349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.829702] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.829702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.829702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.829879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.829914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.830467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.830467] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.941399] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1042.941647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.098356] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.126138] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.126423] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.126501] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.126801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.126960] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.127132] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 0a60f510-2ec8-4974-b0cb-2d671102c335 not found, creating... [ 1043.127406] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.127568] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.127687] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.127911] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.129265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.129265] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.129265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.129265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.129265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.129265] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.129265] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 0a60f510-2ec8-4974-b0cb-2d671102c335 is going to be created. [ 1043.154882] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.155592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.155592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.155592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.155885] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.156190] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.333377] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.333731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.333914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.334504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.334630] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.334916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.335346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.335346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.335701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.335701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.336064] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.336374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.336374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.336619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.336853] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.337085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.337168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.337327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.337445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.337570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.337879] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.567086] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb72a34f-bda3-4818-a17c-194f6b875921 in Status: SUCCESS [ 1043.567412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.602637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.603061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.603061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.603301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.603436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.603567] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be updated. [ 1043.836352] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.836683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.836683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.836808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.836877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.841673] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21cb3633-17f4-47f6-b0c3-4263e0e499b6: rpc.has_security_group_logging(os_id): False [ 1043.859877] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: IN_PROGRESS for 2s [ 1043.887532] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.887720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.887764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.887993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.888102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.888328] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.888434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.888497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.888838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.888838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.888947] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.889010] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.889099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.889269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.889348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.889590] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.889642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.889682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.889805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.889879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.889963] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 is going to be created. [ 1043.920307] env[65660]: INFO networking_nsxv3.common.synchronization [req-2e81b6c0-3219-4a56-9c2e-4c99355bb01d req-f778d775-aa66-48c6-92a6-a7e6158208dd service nova] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_rules [ 1043.920307] env[65660]: INFO networking_nsxv3.common.synchronization [req-2e81b6c0-3219-4a56-9c2e-4c99355bb01d req-f778d775-aa66-48c6-92a6-a7e6158208dd service nova] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1043.920307] env[65660]: INFO networking_nsxv3.common.synchronization [req-2e81b6c0-3219-4a56-9c2e-4c99355bb01d req-f778d775-aa66-48c6-92a6-a7e6158208dd service nova] Enqueued Resource ID: 0a60f510-2ec8-4974-b0cb-2d671102c335 with Priority: HIGHEST for action port [ 1043.920307] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_rules [ 1043.920307] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1043.920307] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a60f510-2ec8-4974-b0cb-2d671102c335 with Priority: HIGHEST for action port [ 1043.920307] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.920307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.920595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.920595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.920655] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.922543] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.922744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.923188] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a60f510-2ec8-4974-b0cb-2d671102c335 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.923763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.923832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.924028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.924324] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a60f510-2ec8-4974-b0cb-2d671102c335',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.991179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.991179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.991179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.991179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.991179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.008975] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 in Status: IN_PROGRESS for 2s [ 1044.423659] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.423857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.430917] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a60f510-2ec8-4974-b0cb-2d671102c335 with status ACTIVE [ 1044.430917] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.430917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.430917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.430917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.430917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.430917] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.430917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.431239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.431385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.431510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.431717] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.431846] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.431902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.432525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.432525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.432525] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a60f510-2ec8-4974-b0cb-2d671102c335 is going to be updated. [ 1044.456934] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.457157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.457194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.457410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.457548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.457721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a60f510-2ec8-4974-b0cb-2d671102c335" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.873224] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1045.873824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.873824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.874358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.874612] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.874867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.874971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.875212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.875364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.875482] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.029861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 in Status: SUCCESS [ 1046.030278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.378742] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.861317] env[65660]: INFO networking_nsxv3.common.synchronization [req-d3236a64-3f39-43c7-a5c5-f3db7ff8bc44 req-208dae73-5645-4a8a-abe1-af10ee9c317a tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1046.865186] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1046.866100] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.866323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.866509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.867117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.867117] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.867288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.867340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.867577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.867725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.868189] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.881865] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.373410] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.385601] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.386131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.386131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.386131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.386281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.386316] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be updated. [ 1047.411168] env[65660]: INFO networking_nsxv3.common.synchronization [req-c06f8f4c-c3c9-46ce-9b7c-692373c50f7b req-e458edd0-9224-4568-b323-e434d5157cda tempest-ServerRescueNegativeTestJSON-2093428704 tempest-ServerRescueNegativeTestJSON-2093428704-project-member] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 1047.412575] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGHEST for action security_group_members [ 1047.412575] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.412820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.412820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.412967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.413519] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.413637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.413697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.413869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.413957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.414070] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.419774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.419906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.420984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.421227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.421688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.435317] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: IN_PROGRESS for 2s [ 1047.878893] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.916675] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.917166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.917166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.917531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.952694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.953469] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.953821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.954052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.955384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.955384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.955384] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be updated. [ 1047.988913] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.989031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.989116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.990167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.990167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.005098] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: IN_PROGRESS for 2s [ 1048.383218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.383455] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.383519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.383707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.383799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.383904] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1048.454496] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.454496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.454496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.454496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.455346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.486491] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1049.447031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1049.447031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.447031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.447031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.447031] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.447031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.447031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.447646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.447646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.447646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.447740] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.952803] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.952803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.952803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.953108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.953151] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.953244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.953310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.953456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.953546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.953635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.953781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.953872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.953980] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.954081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.954216] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.954305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.954359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.954495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.954568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.954647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.954746] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.018342] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 in Status: SUCCESS [ 1050.018531] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 deletion is rescheduled due to dependency. [ 1050.018651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.459119] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4: rpc.has_security_group_logging(os_id): False [ 1050.481333] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.481333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.481670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.481670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.497034] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1050.497430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.506220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.506519] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.506657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.506738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.506986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.507092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.507357] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.507470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.507542] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.508581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.508581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.508581] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.508581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.508581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.508581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.508581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.508581] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be updated. [ 1050.576054] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.576054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.576054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.576054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.576054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.591116] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: IN_PROGRESS for 2s [ 1051.791503] env[65660]: INFO networking_nsxv3.common.synchronization [req-23dafc98-58a3-4419-85f1-b605fc563ea2 req-e6880c2f-9e0e-44e5-83a5-0d7f55cb9296 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1051.792780] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1051.792780] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.792780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.792780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.792780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.793198] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.793198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.793198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.793198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.793416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.793416] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.208519] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.208519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.208519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.208809] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.209037] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.209191] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.209307] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.209556] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.209649] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.209933] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.210071] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.210183] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.210294] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.210404] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.210508] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.210642] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.231788] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.231993] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.232112] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.232291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.232565] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-adee3f9a-e360-4f45-b874-21d778e592d3 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.232797] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.232969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.233375] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.233433] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adee3f9a-e360-4f45-b874-21d778e592d3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.296407] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.296598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.296655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.296874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.325571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.326008] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.326200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.326317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.326597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.326733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.326881] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1052.365344] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.365555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.365681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.366218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.366218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.376747] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1052.605996] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1052.606251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.735829] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.737051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.737051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.737051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.737051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.737051] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port adee3f9a-e360-4f45-b874-21d778e592d3 not found, creating... [ 1052.737051] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.737409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.737409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.737688] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.737688] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.737999] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.738169] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.738279] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.738493] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.738638] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.738766] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: adee3f9a-e360-4f45-b874-21d778e592d3 is going to be created. [ 1052.771094] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.771342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.771466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.771756] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.771987] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.772228] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.259831] env[65660]: INFO networking_nsxv3.common.synchronization [req-cda49e04-ecdf-4b07-ab4b-9951ff28be4c req-f09de472-438e-4463-b767-d64eb73fec5e tempest-ServerMetadataNegativeTestJSON-867914049 tempest-ServerMetadataNegativeTestJSON-867914049-project-member] Enqueued Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_members [ 1053.260847] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGHEST for action security_group_members [ 1053.261069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.261739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.261839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.262036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.262206] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.262310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.262373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.262600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.262600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.262709] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.556710] env[65660]: INFO networking_nsxv3.common.synchronization [req-23dafc98-58a3-4419-85f1-b605fc563ea2 req-2abdbe97-8de5-4409-91a6-446769f8e61d service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1053.556710] env[65660]: INFO networking_nsxv3.common.synchronization [req-23dafc98-58a3-4419-85f1-b605fc563ea2 req-2abdbe97-8de5-4409-91a6-446769f8e61d service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1053.556919] env[65660]: INFO networking_nsxv3.common.synchronization [req-23dafc98-58a3-4419-85f1-b605fc563ea2 req-2abdbe97-8de5-4409-91a6-446769f8e61d service nova] Enqueued Resource ID: adee3f9a-e360-4f45-b874-21d778e592d3 with Priority: HIGHEST for action port [ 1053.557560] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1053.557776] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1053.557906] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adee3f9a-e360-4f45-b874-21d778e592d3 with Priority: HIGHEST for action port [ 1053.558242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.558404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.558404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.558601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.558692] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.559800] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.559981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.560201] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-adee3f9a-e360-4f45-b874-21d778e592d3 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.560342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.560439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.560660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.560738] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adee3f9a-e360-4f45-b874-21d778e592d3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.765119] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.765330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.765407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.765693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.765798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.766057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.766057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.766235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.766287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.766417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.766471] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 is going to be updated. [ 1053.793850] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.794016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.794096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.794313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.794462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.804728] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 in Status: IN_PROGRESS for 2s [ 1054.063326] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.063710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.063956] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adee3f9a-e360-4f45-b874-21d778e592d3 with status ACTIVE [ 1054.064230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.064356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.064440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.064682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.064772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.065022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.065140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.065206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.065382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.065464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.065687] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.065775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.065851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.066305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.066482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.066670] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adee3f9a-e360-4f45-b874-21d778e592d3 is going to be updated. [ 1054.090196] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.090435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.090512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.090859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.091066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.091313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adee3f9a-e360-4f45-b874-21d778e592d3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.358195] env[65660]: INFO networking_nsxv3.common.synchronization [req-5e19cf09-ed67-41c3-92dd-dce366afffbb req-988f2d11-057c-4b75-9536-32fccf62fde5 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1054.358195] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1054.358195] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.358694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.358694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.358694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.358813] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.358868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.358909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.359989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.359989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.359989] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.389503] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1054.389865] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1054.389962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.390161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.390340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.390518] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.390658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.390775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.390883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.391051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.391183] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.688750] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.689449] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.689701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.690045] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.690429] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.690633] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.690825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.691183] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.691375] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.691622] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.691787] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.691935] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.692094] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.692371] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.692438] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.695464] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.715641] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.715641] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.715641] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.715827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.716155] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-a4f6c223-2eae-4bac-bdd1-28423b72aafe taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.716371] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.716498] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.716853] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.718048] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4f6c223-2eae-4bac-bdd1-28423b72aafe',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.862563] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.893589] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.221036] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.221036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.221036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.221373] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.221447] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.221604] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port a4f6c223-2eae-4bac-bdd1-28423b72aafe not found, creating... [ 1055.221859] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.222031] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.222156] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.222369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.222508] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.222781] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.222937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.223064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.223273] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.223421] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.223557] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: a4f6c223-2eae-4bac-bdd1-28423b72aafe is going to be created. [ 1055.245763] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.246059] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.246177] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.246458] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.246689] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.246916] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.365519] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.397028] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.815016] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 in Status: SUCCESS [ 1055.815254] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 deletion is rescheduled due to dependency. [ 1055.815376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.868162] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.868310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.868310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.869425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.869425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.869425] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be updated. [ 1055.896764] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.897791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.897791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.897791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.897791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.898585] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.898708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.898708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.898875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.898944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.899128] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1055.912136] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: IN_PROGRESS for 2s [ 1055.928821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.929531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.929531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.929531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.931371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.942477] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1055.944605] env[65660]: INFO networking_nsxv3.common.synchronization [req-5e19cf09-ed67-41c3-92dd-dce366afffbb req-7a33ce96-b58f-4f82-9dc8-229e91f214a8 service nova] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 1055.944931] env[65660]: INFO networking_nsxv3.common.synchronization [req-5e19cf09-ed67-41c3-92dd-dce366afffbb req-7a33ce96-b58f-4f82-9dc8-229e91f214a8 service nova] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1055.945678] env[65660]: INFO networking_nsxv3.common.synchronization [req-5e19cf09-ed67-41c3-92dd-dce366afffbb req-7a33ce96-b58f-4f82-9dc8-229e91f214a8 service nova] Enqueued Resource ID: a4f6c223-2eae-4bac-bdd1-28423b72aafe with Priority: HIGHEST for action port [ 1055.947116] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_rules [ 1055.947381] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1055.947628] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f6c223-2eae-4bac-bdd1-28423b72aafe with Priority: HIGHEST for action port [ 1055.948754] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.948938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.949047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.949301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.949626] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.951304] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.951945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.952231] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4f6c223-2eae-4bac-bdd1-28423b72aafe taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.952793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.952793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.954113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.954246] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4f6c223-2eae-4bac-bdd1-28423b72aafe',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.458550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.460405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.460405] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4f6c223-2eae-4bac-bdd1-28423b72aafe with status ACTIVE [ 1056.460405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.460405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.460405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.460405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.460405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.460405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.460405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.460843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.462110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.463066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.463330] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.463446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.463513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.463680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.463761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.463922] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4f6c223-2eae-4bac-bdd1-28423b72aafe is going to be updated. [ 1056.492887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.492887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.493138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.493291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.493482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.493657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4f6c223-2eae-4bac-bdd1-28423b72aafe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.815517] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa75e393-7da2-4c3d-b3bc-27a3f01a731a req-1765be16-436b-46e6-84c6-edfd19777923 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_members [ 1056.816271] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_members [ 1056.816677] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.816834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.816934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.817284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.817562] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.817747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.817936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.818308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.818308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.818594] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.220188] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.220542] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.220649] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.220900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.221201] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.221368] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.221693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.221693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.221848] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.222121] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.222247] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.222357] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.222466] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.222643] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.222799] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.222973] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.246448] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.246617] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.246747] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.247087] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.247289] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-0efd2e94-5218-4dd2-8a76-b34f10de0df3 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.247464] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.247560] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.247900] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.248053] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0efd2e94-5218-4dd2-8a76-b34f10de0df3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.321139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.321302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.321357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.321574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.321665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.321868] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.321966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.322041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.322198] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.322270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.322352] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 332826ee-e169-4398-8162-f86ad56e690d already deleted. [ 1057.322430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.753301] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.753301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.753301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.753301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.753301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.753301] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 0efd2e94-5218-4dd2-8a76-b34f10de0df3 not found, creating... [ 1057.753301] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.753301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.753301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.754191] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.754791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.755512] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.755906] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.756261] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.756666] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.756955] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.758638] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 0efd2e94-5218-4dd2-8a76-b34f10de0df3 is going to be created. [ 1057.780030] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.780030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.780030] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.780410] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.780695] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.780979] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.921251] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1057.921482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.921656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.921936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.922153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.922277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.922343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.922510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.922638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.922685] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.955778] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1057.956210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.956414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.956652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.956862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.956985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.957062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.957228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.957306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.957392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.957487] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.426257] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.462042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.462042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.462042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.462042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.462042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.463127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.463127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.463127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.463127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.463127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.463127] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.532142] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa75e393-7da2-4c3d-b3bc-27a3f01a731a req-5105d57d-cbb1-4cf9-8041-801da7780e2a service nova] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_rules [ 1058.532142] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa75e393-7da2-4c3d-b3bc-27a3f01a731a req-5105d57d-cbb1-4cf9-8041-801da7780e2a service nova] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_members [ 1058.532142] env[65660]: INFO networking_nsxv3.common.synchronization [req-fa75e393-7da2-4c3d-b3bc-27a3f01a731a req-5105d57d-cbb1-4cf9-8041-801da7780e2a service nova] Enqueued Resource ID: 0efd2e94-5218-4dd2-8a76-b34f10de0df3 with Priority: HIGHEST for action port [ 1058.533135] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_rules [ 1058.533135] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_members [ 1058.533135] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0efd2e94-5218-4dd2-8a76-b34f10de0df3 with Priority: HIGHEST for action port [ 1058.533461] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.533597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.533662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.534670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.534670] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.535632] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.537790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.537790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.537790] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.539547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0efd2e94-5218-4dd2-8a76-b34f10de0df3 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.540837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.540936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.541260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.541365] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0efd2e94-5218-4dd2-8a76-b34f10de0df3',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.929973] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.966292] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2663bd-4c5a-4280-b2b0-ccd214332642: rpc.has_security_group_logging(os_id): False [ 1058.984659] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.986040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.986040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.986714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.986714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.986714] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.986714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.986990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.986990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.987156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.987321] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.987406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.987470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.987673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.987725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.987899] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.988017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.988069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.991028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.991028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.991028] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1059.043245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.043395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.043621] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.045489] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0efd2e94-5218-4dd2-8a76-b34f10de0df3 with status ACTIVE [ 1059.045489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.045489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.045489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.045791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.045791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.045859] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.045975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.046032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.047077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.047077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.047077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.047077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.047077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.047563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.047563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.047563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0efd2e94-5218-4dd2-8a76-b34f10de0df3 is going to be updated. [ 1059.065819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.066637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.066637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.066637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.066637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.077454] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.077637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.077681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.077874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.078030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.078216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0efd2e94-5218-4dd2-8a76-b34f10de0df3" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.085283] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1059.432600] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.432849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.432849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.433121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.433211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.433316] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be updated. [ 1059.465987] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.466274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.466274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.466424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.466576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.479392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: IN_PROGRESS for 2s [ 1059.545516] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.050186] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.050533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.050533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.051259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.051259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.051259] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 332826ee-e169-4398-8162-f86ad56e690d is going to be created. [ 1060.079153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.079386] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.079439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.079984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.081735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.106901] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 332826ee-e169-4398-8162-f86ad56e690d in Status: UNINITIALIZED for 2s [ 1061.103497] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1061.104924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.492846] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1061.493075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.493240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.493494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.493718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.493963] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.494056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.494217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.494300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.494588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.494588] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.000703] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.121190] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 332826ee-e169-4398-8162-f86ad56e690d in Status: SUCCESS [ 1062.121190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.121715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.121715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.121828] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.122158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.122158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.122335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.122382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.122512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.122755] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.219448] env[65660]: INFO networking_nsxv3.common.synchronization [req-d4508766-dd87-48f2-b568-095366be30d7 req-6bb69735-40bc-4ab4-aac8-2774f5fd6c75 tempest-FloatingIPsAssociationTestJSON-885564246 tempest-FloatingIPsAssociationTestJSON-885564246-project-member] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1062.219674] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1062.220224] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.220396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.221116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.221116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.221116] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.221116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.221116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.221678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.221783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.221907] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.505368] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de4557e9-9a44-4482-869f-e690653fe59e: rpc.has_security_group_logging(os_id): False [ 1062.529483] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.529483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.529483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.529483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.558518] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.559870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.560035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.561013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.561013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.561013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.561013] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be updated. [ 1062.626395] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.644716] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.644940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.645064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.645971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.645971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.660465] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: IN_PROGRESS for 2s [ 1062.725048] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.129763] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 332826ee-e169-4398-8162-f86ad56e690d: rpc.has_security_group_logging(os_id): False [ 1063.149474] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.149474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.149474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.149474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.149474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.149474] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.149927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.149927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.149927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.149927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.149927] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 332826ee-e169-4398-8162-f86ad56e690d is going to be created. [ 1063.219538] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.219781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.219781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.220741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.220741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.228066] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.237701] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 332826ee-e169-4398-8162-f86ad56e690d in Status: IN_PROGRESS for 2s [ 1063.730353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.730771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.730771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.730892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.731008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.731124] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be updated. [ 1063.775652] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.775839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.775952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.776179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.776365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.786606] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: IN_PROGRESS for 2s [ 1063.849964] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.850193] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.850322] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.850597] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.850901] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.851167] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.851364] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.851702] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.851945] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.852289] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.852487] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.852678] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.852863] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.853083] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.853269] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.853482] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.906258] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.906561] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.053 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1063.907398] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.907398] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-609" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.907589] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-0cbe4161-3405-42ff-a87d-758637fabede taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.907737] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.907883] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.908240] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.908397] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbe4161-3405-42ff-a87d-758637fabede',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.412356] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.412770] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.412770] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.413090] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.413204] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.413666] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.413976] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.414175] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.414396] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.414565] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.414871] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.415087] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.415254] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.415539] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.415635] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.415820] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 0cbe4161-3405-42ff-a87d-758637fabede is going to be updated. [ 1064.440906] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.441215] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.441371] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.441676] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.441932] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.442212] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.677859] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1064.677859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.150816] env[65660]: INFO networking_nsxv3.common.synchronization [req-16dbefc6-90bb-4365-b00e-b1b3771ead7e req-b034b2db-e687-447e-b3e7-0c31152bed4b service nova] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_rules [ 1065.151073] env[65660]: INFO networking_nsxv3.common.synchronization [req-16dbefc6-90bb-4365-b00e-b1b3771ead7e req-b034b2db-e687-447e-b3e7-0c31152bed4b service nova] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 1065.151260] env[65660]: INFO networking_nsxv3.common.synchronization [req-16dbefc6-90bb-4365-b00e-b1b3771ead7e req-b034b2db-e687-447e-b3e7-0c31152bed4b service nova] Enqueued Resource ID: 0cbe4161-3405-42ff-a87d-758637fabede with Priority: HIGHEST for action port [ 1065.151858] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_rules [ 1065.152059] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 1065.152242] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cbe4161-3405-42ff-a87d-758637fabede with Priority: HIGHEST for action port [ 1065.152679] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.153126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.153126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.153265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.153323] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.155235] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.155235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.155235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.155446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.155822] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.155822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.155822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.156058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.156094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.156195] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.157147] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cbe4161-3405-42ff-a87d-758637fabede taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.157306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.157408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.157676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.157775] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbe4161-3405-42ff-a87d-758637fabede',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.251756] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 332826ee-e169-4398-8162-f86ad56e690d in Status: SUCCESS [ 1065.252241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.374236] env[65660]: INFO networking_nsxv3.common.synchronization [None req-671e9c6b-42bc-469c-8768-0b12eadb6923 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1065.375139] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1065.375364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.375672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.375672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.375869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.375950] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.377366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.377502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.377738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.377860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.377990] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.659668] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.660221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.660556] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.663915] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cbe4161-3405-42ff-a87d-758637fabede with status ACTIVE [ 1065.664205] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.664301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.664395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.664576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.664662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.664861] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.665015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.665146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.665290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.665407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.665590] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.665682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.665760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.666407] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.666573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.666715] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cbe4161-3405-42ff-a87d-758637fabede is going to be updated. [ 1065.689874] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.690088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.690237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.690429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.690618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.690826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cbe4161-3405-42ff-a87d-758637fabede" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.796950] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1065.797203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.880538] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.880731] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.880810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.881072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.881399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.881399] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.881532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.881576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.881692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.881761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.881861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be deleted. [ 1065.919821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.920308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.920308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.920410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.920459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.920559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.164066] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.667327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.668655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.668655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.668655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.668655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.668655] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 1066.706256] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.706483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.706483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.706678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.706819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.716330] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 1068.730161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 1068.730550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.730550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.730761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.731024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.731099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.731137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.731295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.731361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.731451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.731543] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.234436] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.234744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.234805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.235036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.235435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.235553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.235619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.235788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.235876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.235968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.236131] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.236327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.236392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.236538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.236678] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.236771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.236832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.236968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.237055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.237154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.237214] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.739608] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3402fe38-bb82-4e23-ab22-23f54a22de87: rpc.has_security_group_logging(os_id): False [ 1069.758027] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.758230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.758230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.758683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.779779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.780056] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.780182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.780265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.780553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.780645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.782374] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.782374] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.782374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.782374] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 1069.846838] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.846838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.846838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.846838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.847149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.897243] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 1070.376667] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1070.376667] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1071.886358] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 1071.886358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.480339] env[65660]: INFO networking_nsxv3.common.synchronization [req-9278c0aa-6140-430e-859a-41981eaca792 req-a3011da0-b2e0-4571-a7ff-47f81dff7a75 tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1074.480978] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1074.481882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.485225] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.485225] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.485225] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.537934] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.537934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.537934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.538779] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.539296] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.539516] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.539639] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.539972] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.540140] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.540362] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.540482] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.540593] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.540703] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.540868] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.540986] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.541142] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.568524] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.568784] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.568934] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.569157] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.569733] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-9bec7b1c-2a17-4212-ac32-84508fabdbe9 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.569733] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.569928] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.570346] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.570552] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bec7b1c-2a17-4212-ac32-84508fabdbe9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.924529] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.924776] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.924935] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.925258] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.925560] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.925720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.925836] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.926497] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.926731] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.927128] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.927349] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.927557] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.927689] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.927803] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.927917] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.928083] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.953645] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.953917] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.954050] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.954245] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.954637] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-67a40910-bd07-4dfb-b7a3-caa63931df9e taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.954825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.954949] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.955524] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.955935] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67a40910-bd07-4dfb-b7a3-caa63931df9e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.990977] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.074627] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.074853] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.074980] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.075419] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.075571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.075796] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 9bec7b1c-2a17-4212-ac32-84508fabdbe9 not found, creating... [ 1075.076015] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.076269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.076425] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.077255] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.077746] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.078167] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.078345] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.078465] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.078709] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.078844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.078990] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 is going to be created. [ 1075.102816] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.103064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.103230] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.103492] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.103769] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.104021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.459089] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.459400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.459571] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.460032] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.460298] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.460570] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 67a40910-bd07-4dfb-b7a3-caa63931df9e not found, creating... [ 1075.460991] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.461344] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.461520] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.461875] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.462112] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.462563] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.462828] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.463078] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.463481] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.463710] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.463975] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 67a40910-bd07-4dfb-b7a3-caa63931df9e is going to be created. [ 1075.490938] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.491377] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.491377] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.491610] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.491846] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.492197] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.493192] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.834170] env[65660]: INFO networking_nsxv3.common.synchronization [req-6b253595-5015-40d8-80d6-d7500d2cc40e req-92636db0-4f5c-4146-a230-a09cfb276f85 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 1075.834369] env[65660]: INFO networking_nsxv3.common.synchronization [req-6b253595-5015-40d8-80d6-d7500d2cc40e req-92636db0-4f5c-4146-a230-a09cfb276f85 service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1075.834581] env[65660]: INFO networking_nsxv3.common.synchronization [req-6b253595-5015-40d8-80d6-d7500d2cc40e req-92636db0-4f5c-4146-a230-a09cfb276f85 service nova] Enqueued Resource ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 with Priority: HIGHEST for action port [ 1075.835431] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 1075.835618] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1075.835744] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 with Priority: HIGHEST for action port [ 1075.836331] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.836331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.836450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.836660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.836744] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.837883] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.838056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.838195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.838364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.838700] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.838700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.838818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.838964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.839097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.839230] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.842435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bec7b1c-2a17-4212-ac32-84508fabdbe9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.842435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.842435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.842435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.842435] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bec7b1c-2a17-4212-ac32-84508fabdbe9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.995372] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.995574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.995641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.996320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.996320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.996320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1076.035864] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.036099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.036099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.036383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.036551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.048293] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1076.238774] env[65660]: INFO networking_nsxv3.common.synchronization [req-9278c0aa-6140-430e-859a-41981eaca792 req-1ce6f5f6-a788-4c3b-8f6e-588c785b0cdf service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1076.239238] env[65660]: INFO networking_nsxv3.common.synchronization [req-9278c0aa-6140-430e-859a-41981eaca792 req-1ce6f5f6-a788-4c3b-8f6e-588c785b0cdf service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1076.239465] env[65660]: INFO networking_nsxv3.common.synchronization [req-9278c0aa-6140-430e-859a-41981eaca792 req-1ce6f5f6-a788-4c3b-8f6e-588c785b0cdf service nova] Enqueued Resource ID: 67a40910-bd07-4dfb-b7a3-caa63931df9e with Priority: HIGHEST for action port [ 1076.240382] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1076.240616] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1076.240803] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67a40910-bd07-4dfb-b7a3-caa63931df9e with Priority: HIGHEST for action port [ 1076.241236] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.241433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.241550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.241892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.243143] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.244749] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.244853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.246209] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-67a40910-bd07-4dfb-b7a3-caa63931df9e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.246353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.246404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.246623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.246702] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67a40910-bd07-4dfb-b7a3-caa63931df9e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.343786] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.348327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.348327] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bec7b1c-2a17-4212-ac32-84508fabdbe9 with status ACTIVE [ 1076.348327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.348327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.348327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.348327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.348915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.348915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.348915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.349339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.349503] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 is going to be updated. [ 1076.382401] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.382757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.382757] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.383050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.383327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.384050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.751361] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.751361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.751361] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67a40910-bd07-4dfb-b7a3-caa63931df9e with status ACTIVE [ 1076.751361] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.751361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.751361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.751361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.751361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.752824] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.752824] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.752824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.752824] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67a40910-bd07-4dfb-b7a3-caa63931df9e is going to be updated. [ 1076.783830] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.784116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.784230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.784566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.784795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.785069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67a40910-bd07-4dfb-b7a3-caa63931df9e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.852712] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.356087] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.356322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.356426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.356690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.356798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.356940] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be created. [ 1077.388749] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.388948] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.388991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.389243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.389499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.402110] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: UNINITIALIZED for 2s [ 1078.059672] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1078.059672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.059672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.060223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.060223] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.060223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.060399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.060474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.060559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.060680] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.563605] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.066469] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.415024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 1079.415274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.415715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.415836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.416100] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.416316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.416617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.416617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.416713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.416791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.416884] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.571488] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.571915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.571915] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.572059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.572551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.572551] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1079.624203] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.624434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.624434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.624774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.624961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.636309] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1079.919906] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.920144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.920268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.920576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.921278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.921278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.921278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.921501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.921501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.921550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.921794] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.921928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.922023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.922211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.922398] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.922569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.922673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.922813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.922924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.923173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.923321] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.425710] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaef59ac-b94f-47d8-8852-ec864d2e9eeb: rpc.has_security_group_logging(os_id): False [ 1080.446734] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.447204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.447204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.447498] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.447570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.447985] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.447985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.447985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.448274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.448274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.448456] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.448563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.448922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.448922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.448922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.449078] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.449149] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.449189] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.449823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.449823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.449823] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be created. [ 1080.530040] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.530040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.530040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.530266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.530375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.544388] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 1081.241793] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1081.242136] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1081.649731] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1081.650121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.650262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.650495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.650825] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.651012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.651131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.651341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.651476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.652422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.652422] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.157277] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.157277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.157277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.157625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.157756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.157894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.157989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.158195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.158286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.158460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.158608] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.158761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.158821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.158965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.159133] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.159233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.159299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.159437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.159501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.159593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.159937] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.561493] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 1082.561905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.663054] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1082.684559] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.684791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.684869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.685155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.685302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.685598] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.685756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.686076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.686327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.686418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.686676] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.686912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.686979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.687161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.687276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.687547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.687667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.687714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.687872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.687951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.688055] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1082.763591] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.763755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.763828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.764091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.764318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.779650] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1083.545621] env[65660]: INFO networking_nsxv3.common.synchronization [req-2163555d-3d2d-4c16-a5be-b5f0330e24cb req-57ffa3f9-da7b-446d-bff1-88aa1720e332 tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1083.547604] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1083.547793] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.548029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.548166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.548990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.549299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.549519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.549655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.549950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.550143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.550613] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.866069] env[65660]: INFO networking_nsxv3.common.synchronization [req-ca535db1-ba46-485e-8d1f-9ceced71b6bd req-f00922c5-c10f-4019-9155-e904560377c5 tempest-FloatingIPsAssociationTestJSON-885564246 tempest-FloatingIPsAssociationTestJSON-885564246-project-member] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1083.867617] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGHEST for action security_group_members [ 1083.867973] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.868126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.868468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.868468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.868599] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.868719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.868965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.868965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.869088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.869214] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.053121] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.053341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.053432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.053678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.053877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.054145] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.054145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.054270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.054394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.054479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.054563] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1084.084861] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.085066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.085066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.086165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.086349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.098430] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1084.371662] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.371866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.371932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.372409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.372647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.373089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.373233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.373288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.373589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.373700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.373796] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be updated. [ 1084.420148] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.420371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.420489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.420728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.420931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.431421] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: IN_PROGRESS for 2s [ 1084.795209] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1084.795546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.798866] env[65660]: INFO networking_nsxv3.common.synchronization [req-f102c974-407d-4e67-82ff-d71a88de86bb req-c1332222-382d-45d1-95cb-b8de72256891 tempest-ImagesOneServerTestJSON-2060300439 tempest-ImagesOneServerTestJSON-2060300439-project-member] Enqueued Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_members [ 1084.799259] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGHEST for action security_group_members [ 1084.799576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.799699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.799767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.799964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.801015] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.801015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.801015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.801015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.801015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.801015] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.303052] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.303432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.303432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.303723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.303834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.304089] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.304222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.304401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.304710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.304861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.305017] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 is going to be updated. [ 1085.358247] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.358464] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.358544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.358818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.359025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.369502] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 in Status: IN_PROGRESS for 2s [ 1086.109481] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1086.109686] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 1086.109837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.250726] env[65660]: INFO networking_nsxv3.common.synchronization [req-1b44ff7e-852f-464a-8dff-d0de5136dd3a req-4b043008-c220-4c27-8926-a817cdb64e90 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_members [ 1086.250726] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGHEST for action security_group_members [ 1086.250726] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.250726] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.250726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.250726] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.444076] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 in Status: SUCCESS [ 1086.444393] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 deletion is rescheduled due to dependency. [ 1086.444393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.753088] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.753257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.753331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.753561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.753957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.753957] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.754083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.754083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.754231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.754860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754860] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 is going to be updated. [ 1086.788914] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.788914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.788914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.789207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.789207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.801206] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb72a34f-bda3-4818-a17c-194f6b875921 in Status: IN_PROGRESS for 2s [ 1086.998472] env[65660]: INFO networking_nsxv3.common.synchronization [req-5ca754fc-42e7-4100-8f83-2c29b9543471 req-c617eb6c-b513-48ab-9646-cf43f36833df tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1086.999917] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1087.000427] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.000617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.000730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.001554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.001640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.001789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.001882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.002255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.002292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.002685] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.384339] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 in Status: SUCCESS [ 1087.384615] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 deletion is rescheduled due to dependency. [ 1087.384802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.431952] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.432301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.432469] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.432763] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.433106] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.433303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.433537] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.433930] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.435088] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.435088] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.435088] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.435088] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.435088] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.435088] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.435324] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.435324] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.461057] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.461360] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.461466] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.461682] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-20" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.462065] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-ac800852-4632-451c-8cf8-8dbe28a55e2f taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.462272] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.462420] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.462822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.462985] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac800852-4632-451c-8cf8-8dbe28a55e2f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.504954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.505180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.505270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.505572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.505703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.505906] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.506048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.506116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.506270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.506356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.506466] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1087.540462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.540659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.540722] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.540984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.541144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.551829] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1087.965290] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.965574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.965709] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.966042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.966220] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.966384] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port ac800852-4632-451c-8cf8-8dbe28a55e2f not found, creating... [ 1087.966728] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.966890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.967021] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.967259] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.967401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.967688] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.967862] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.967978] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.968204] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.968336] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.968502] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: ac800852-4632-451c-8cf8-8dbe28a55e2f is going to be created. [ 1087.998372] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.998619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.998720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.999093] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.999370] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.999686] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.704579] env[65660]: INFO networking_nsxv3.common.synchronization [req-5ca754fc-42e7-4100-8f83-2c29b9543471 req-2e24fd54-04b2-4ce6-8a80-c15f53a85af6 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 1088.704887] env[65660]: INFO networking_nsxv3.common.synchronization [req-5ca754fc-42e7-4100-8f83-2c29b9543471 req-2e24fd54-04b2-4ce6-8a80-c15f53a85af6 service nova] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1088.704887] env[65660]: INFO networking_nsxv3.common.synchronization [req-5ca754fc-42e7-4100-8f83-2c29b9543471 req-2e24fd54-04b2-4ce6-8a80-c15f53a85af6 service nova] Enqueued Resource ID: ac800852-4632-451c-8cf8-8dbe28a55e2f with Priority: HIGHEST for action port [ 1088.705668] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_rules [ 1088.705834] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1088.705931] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac800852-4632-451c-8cf8-8dbe28a55e2f with Priority: HIGHEST for action port [ 1088.706390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.706530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.706745] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.706994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.706994] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.708779] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.709061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.709172] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac800852-4632-451c-8cf8-8dbe28a55e2f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.709309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.709393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.709667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.709699] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac800852-4632-451c-8cf8-8dbe28a55e2f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.811042] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb72a34f-bda3-4818-a17c-194f6b875921 in Status: SUCCESS [ 1088.811641] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 deletion is rescheduled due to dependency. [ 1088.811641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.212192] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.212304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.212507] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac800852-4632-451c-8cf8-8dbe28a55e2f with status ACTIVE [ 1089.212704] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.212831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.212898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.213158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.213302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.213514] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.213654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.213763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.213960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.214064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.214265] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.214505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.214505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.214599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.214692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.214815] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac800852-4632-451c-8cf8-8dbe28a55e2f is going to be updated. [ 1089.241512] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.241666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.241740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.241958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.242121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.242287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac800852-4632-451c-8cf8-8dbe28a55e2f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.487941] env[65660]: INFO networking_nsxv3.common.synchronization [req-7d5e47ca-032e-409f-827a-d4a6e2b28e1e req-0af17079-d61a-46d0-a922-b10a58df1a38 tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1089.487941] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1089.488288] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.488614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.488717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.488933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.489118] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.489241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.489311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.489474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.489563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.489686] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.562672] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1089.562856] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 1089.562974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.563156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.563397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.563555] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.563669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.563737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.563883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.563965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.564077] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.992685] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.067586] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.494939] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.570305] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.000103] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.000103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.000103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.000103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.000103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.000103] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1091.031728] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.031889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.031937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.032169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.032317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.044616] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1091.074116] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.074359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.074443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.074664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.075771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.075771] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1091.112837] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.112985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.113063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.113295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.113457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.125782] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1093.060239] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1093.060239] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.138522] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1093.138522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.138522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.140652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.140890] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.141032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.141122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.141299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.141377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.141469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.141560] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.646644] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.646916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.647571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.647571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.647941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.648412] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.648412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.648562] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.649275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.649275] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.649275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.649275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.649275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.649275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.649641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.650626] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.747174] env[65660]: INFO networking_nsxv3.common.synchronization [None req-74f8367e-9360-4a47-9096-39b89a3d4ef6 None None] Enqueued Resource ID: 8e60b64d-5e5d-4c67-9377-ed84a5010406 with Priority: HIGHEST for action port [ 1093.747791] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e60b64d-5e5d-4c67-9377-ed84a5010406 with Priority: HIGHEST for action port [ 1093.748153] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e60b64d-5e5d-4c67-9377-ed84a5010406 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.748274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e60b64d-5e5d-4c67-9377-ed84a5010406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.748335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e60b64d-5e5d-4c67-9377-ed84a5010406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.748631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e60b64d-5e5d-4c67-9377-ed84a5010406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.748781] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e60b64d-5e5d-4c67-9377-ed84a5010406',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.153644] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e872372-e4f2-43b5-922d-ee045d8baf5b: rpc.has_security_group_logging(os_id): False [ 1094.176987] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.178202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.178202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.178202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.178202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.178202] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.178524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.178524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.178632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.178632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.178860] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.178978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.179064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.179208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.179297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.179550] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.179689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.179747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.179920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.179981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.180321] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1094.248954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.249584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.254035] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e60b64d-5e5d-4c67-9377-ed84a5010406 [ 1094.254035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.254035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.254035] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e60b64d-5e5d-4c67-9377-ed84a5010406 already deleted. [ 1094.255226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e60b64d-5e5d-4c67-9377-ed84a5010406" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.267373] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1095.653148] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.653148] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.653513] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.653543] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.654089] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.654291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.654413] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.654652] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.654822] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.655056] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.655392] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.655392] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.655590] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.655826] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.656047] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.656339] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.675433] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.675433] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.675627] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.675672] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-665" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.676031] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-9bec7b1c-2a17-4212-ac32-84508fabdbe9 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.676214] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.676358] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.676681] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.677674] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bec7b1c-2a17-4212-ac32-84508fabdbe9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.148663] env[65660]: INFO networking_nsxv3.common.synchronization [None req-49afd3a1-2201-4dd6-b66b-727c36ad3230 None None] Enqueued Resource ID: 54bce653-6949-4502-9c52-c00acf575272 with Priority: HIGHEST for action port [ 1096.148663] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bce653-6949-4502-9c52-c00acf575272 with Priority: HIGHEST for action port [ 1096.148839] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-54bce653-6949-4502-9c52-c00acf575272 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.148921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54bce653-6949-4502-9c52-c00acf575272" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.148921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54bce653-6949-4502-9c52-c00acf575272" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.149554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54bce653-6949-4502-9c52-c00acf575272" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.149666] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54bce653-6949-4502-9c52-c00acf575272',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.179848] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.180146] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.180254] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.180530] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.180744] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.181193] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.181430] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.181515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.181746] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.181876] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.182411] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.182592] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.182801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.182905] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.183179] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.183309] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 is going to be updated. [ 1096.208598] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.208990] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.209114] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.209455] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.209699] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.209993] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.281493] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1096.282388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.651673] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54bce653-6949-4502-9c52-c00acf575272 [ 1096.651921] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.652068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.652139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.652349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.652441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.652538] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54bce653-6949-4502-9c52-c00acf575272 already deleted. [ 1096.652823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54bce653-6949-4502-9c52-c00acf575272" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.862908] env[65660]: INFO networking_nsxv3.common.synchronization [req-932fafd7-38f0-4972-9d72-20263f94d058 req-a5ada98d-572d-408a-97aa-82125229e74d tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1096.863557] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1096.863903] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.864091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.864182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.864401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.864561] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.864687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.864768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.864933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.865037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.866363] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.955981] env[65660]: INFO networking_nsxv3.common.synchronization [req-918eb998-508a-4c2e-b351-bc8ff02843cc req-5eb6f7b0-55cd-426a-ac56-2b3cc192c2dc service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 1096.956202] env[65660]: INFO networking_nsxv3.common.synchronization [req-918eb998-508a-4c2e-b351-bc8ff02843cc req-5eb6f7b0-55cd-426a-ac56-2b3cc192c2dc service nova] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1096.956348] env[65660]: INFO networking_nsxv3.common.synchronization [req-918eb998-508a-4c2e-b351-bc8ff02843cc req-5eb6f7b0-55cd-426a-ac56-2b3cc192c2dc service nova] Enqueued Resource ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 with Priority: HIGHEST for action port [ 1096.957122] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_rules [ 1096.957122] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1096.957206] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 with Priority: HIGHEST for action port [ 1096.957520] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.957646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.957714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.958424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.958424] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.959064] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.959196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.959258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.959449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.959604] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.959712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.959759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.959913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.960008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.962182] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.965790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bec7b1c-2a17-4212-ac32-84508fabdbe9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.965966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.966040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.966247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.966332] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bec7b1c-2a17-4212-ac32-84508fabdbe9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.369752] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.369919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.370067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.370227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.370351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.370551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.370650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.370711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.370873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.370977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.371106] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1097.400393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.400393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.400393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.400604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.400604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.411417] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1097.466786] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.467874] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.468040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.472372] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bec7b1c-2a17-4212-ac32-84508fabdbe9 with status ACTIVE [ 1097.472569] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.472850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.472850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.473763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.473763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.473763] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.473763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.473763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.473763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.473763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.474037] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.474147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.474212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.474467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.474552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.474875] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bec7b1c-2a17-4212-ac32-84508fabdbe9 is going to be updated. [ 1097.502902] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.502902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.502902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.503123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.503123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.503888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bec7b1c-2a17-4212-ac32-84508fabdbe9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.968260] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.470587] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.470761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.470835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.471094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.471191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.471307] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 1098.509878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.510057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.510134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.510350] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.510510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.519853] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 1099.422600] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1099.422859] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1099.422909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.529439] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 1100.529821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.529821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.530155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.530387] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.530536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.530626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.530821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.530929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.531032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.531199] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.033637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.033803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.033803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.035497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.035497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.035497] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.036089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.036089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.036089] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.289635] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d9c8029-d756-4dff-b567-e7f1dd72a5ee req-4e084237-f638-425e-9a6f-076eda09dd7c tempest-AttachInterfacesV270Test-2146283310 tempest-AttachInterfacesV270Test-2146283310-project-member] Enqueued Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_members [ 1101.290228] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_members [ 1101.290553] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.290698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.290767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.291062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.291238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.291343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.291406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.291589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.291678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.291770] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.537820] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaef59ac-b94f-47d8-8852-ec864d2e9eeb: rpc.has_security_group_logging(os_id): False [ 1101.556751] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.556918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.557754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.557754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.557754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.557754] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.557754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.557754] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.558135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.558135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.558273] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.558678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.558678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.558678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.558678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.559990] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.559990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.559990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.559990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.559990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.559990] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 1101.628707] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.628707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.628707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.628707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.628707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.642668] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 1101.692189] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-261 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.692189] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-261" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.692458] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-261" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.692912] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-261" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.693364] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.693663] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.693873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.694262] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.694520] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.694862] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.695104] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.695306] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.695517] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.696443] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.696443] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.696443] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.725773] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.725953] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.726105] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.726299] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-261" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.726616] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-9115e293-17f9-48ad-8c6f-c2d3140063d8 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.726823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.726947] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.727322] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.727466] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9115e293-17f9-48ad-8c6f-c2d3140063d8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.794335] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.795216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.795216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.795216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.795714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.795714] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.795714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.795858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.795983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.796134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.796230] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 already deleted. [ 1101.796334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.230576] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.230823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.231182] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.231593] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.231789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.232225] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 9115e293-17f9-48ad-8c6f-c2d3140063d8 not found, creating... [ 1102.232761] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.233119] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.233534] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.233985] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.234480] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.234846] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.235111] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.235235] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.235512] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.235789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.235926] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 9115e293-17f9-48ad-8c6f-c2d3140063d8 is going to be created. [ 1102.261366] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.261626] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.261754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.262073] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.262312] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.262554] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.426678] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c83615d-a4c7-440a-aea3-fdad3cb26406 req-ad8e9af1-15c3-4470-9a61-5e8d9c8d0a18 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_members [ 1102.427961] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGHEST for action security_group_members [ 1102.428372] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.428510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.428581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.428798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.428962] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.429077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.429139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.429293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.429399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.429494] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.932799] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.933108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.933108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.933284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.947497] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d9c8029-d756-4dff-b567-e7f1dd72a5ee req-72f90c67-b5a0-48f7-82b6-bb4a341a27a4 service nova] Enqueued Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_rules [ 1102.947680] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d9c8029-d756-4dff-b567-e7f1dd72a5ee req-72f90c67-b5a0-48f7-82b6-bb4a341a27a4 service nova] Enqueued Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_members [ 1102.947823] env[65660]: INFO networking_nsxv3.common.synchronization [req-0d9c8029-d756-4dff-b567-e7f1dd72a5ee req-72f90c67-b5a0-48f7-82b6-bb4a341a27a4 service nova] Enqueued Resource ID: 9115e293-17f9-48ad-8c6f-c2d3140063d8 with Priority: HIGHEST for action port [ 1102.948405] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_rules [ 1102.948546] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_members [ 1102.948642] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9115e293-17f9-48ad-8c6f-c2d3140063d8 with Priority: HIGHEST for action port [ 1102.949203] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.949340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.949430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.949663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.950288] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.950953] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.951086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.951154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.951339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.951824] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.951946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.952851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.952851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.952851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.952851] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.954127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-9115e293-17f9-48ad-8c6f-c2d3140063d8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.954127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.954127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.954127] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.954127] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9115e293-17f9-48ad-8c6f-c2d3140063d8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.955579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.957036] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.957036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.957036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.957036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.957036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.957036] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db is going to be updated. [ 1103.070184] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.070623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.070623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.070715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.070838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.081175] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a06f441-5f17-4ab5-b491-331edf1151db in Status: IN_PROGRESS for 2s [ 1103.456179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.456393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.456490] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.458745] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9115e293-17f9-48ad-8c6f-c2d3140063d8 with status ACTIVE [ 1103.458972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.460675] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.460675] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.460675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.461431] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9115e293-17f9-48ad-8c6f-c2d3140063d8 is going to be updated. [ 1103.499114] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.499372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.499372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.499559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.499700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.499871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9115e293-17f9-48ad-8c6f-c2d3140063d8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.579370] env[65660]: INFO networking_nsxv3.common.synchronization [req-ff1e3100-cecd-4a8e-8c9a-4cdc693c85fe req-51d8437a-591b-4d28-91c6-ce9a86796502 tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1103.579970] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1103.580712] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.580845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.580916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.581589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.581589] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.581589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.581589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.582285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.582285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.582285] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.599421] env[65660]: INFO networking_nsxv3.common.synchronization [req-413a2caa-50d3-4dbf-89a5-eb1218753b70 req-85da9a37-c3ff-42ec-8f61-f8f3103d0d2a tempest-ServerDiskConfigTestJSON-1527972788 tempest-ServerDiskConfigTestJSON-1527972788-project-member] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1103.599930] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGHEST for action security_group_members [ 1103.600269] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.600391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.600462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.600683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.600834] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.600938] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.601039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.601206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.601294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.601389] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.662634] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 1103.662978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.959553] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.084638] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.084840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.084916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.085175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.106151] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.106355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.108628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.108856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.108984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.109104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.109372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.109619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.109619] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1104.110897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.111124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.111242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.111635] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.111635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.111799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.111883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.111984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.112104] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be updated. [ 1104.143701] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.143918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.143918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.144150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.144295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.146370] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.146560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.146640] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.146844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.146974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.169125] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1104.169879] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: IN_PROGRESS for 2s [ 1104.462568] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.462737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.462812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.463067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.463167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.463316] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 is going to be created. [ 1104.491127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.491317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.491317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.491517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.491679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.501351] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 in Status: UNINITIALIZED for 2s [ 1105.091893] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a06f441-5f17-4ab5-b491-331edf1151db in Status: SUCCESS [ 1105.092212] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db deletion is rescheduled due to dependency. [ 1105.092396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.181273] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1106.181554] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 deletion is rescheduled due to dependency. [ 1106.181632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.182429] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b in Status: SUCCESS [ 1106.182609] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b deletion is rescheduled due to dependency. [ 1106.182713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.511974] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 in Status: SUCCESS [ 1106.512176] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.512397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.512637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.512846] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.512964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.513051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.513219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.513310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.513401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.513497] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.836090] env[65660]: INFO networking_nsxv3.common.synchronization [req-6439aefc-e362-471a-a51a-50f40843944c req-103f33dc-14f4-4ab7-8842-c0b68ff5d36d tempest-ServersNegativeTestJSON-634766943 tempest-ServersNegativeTestJSON-634766943-project-member] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 1106.837364] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGHEST for action security_group_members [ 1106.837364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.837364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.837364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.837364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.837630] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.837630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.837709] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.837825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.837879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.837987] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.016489] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.016764] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.016840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.017069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.017257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.017363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.017427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.017598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.017686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.017779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.017970] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.018112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.018161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.018306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.018447] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.018540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.018601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.018755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.018911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.018965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.019060] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.077927] env[65660]: INFO networking_nsxv3.common.synchronization [req-d767f554-b6c6-41d3-9e19-a00de135808a req-b9cedf45-3904-4187-bf52-5f4a9315f70e tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1107.078552] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1107.078871] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.078993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.079114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.079290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.079444] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.079577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.079642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.079787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.079874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.079981] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.340262] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.340711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.340711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.340711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.340893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.341046] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.341142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.341142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.341314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.341401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.341464] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be updated. [ 1107.385661] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.385839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.385839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.386043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.386286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.397694] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: IN_PROGRESS for 2s [ 1107.464043] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.464276] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.464559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.464718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.465014] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.465209] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.465302] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.465526] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.465682] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.465928] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.466070] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.466255] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.466310] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.466579] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.466579] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.466579] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.488298] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.488298] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.488508] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.488673] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.489117] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-11e0074a-e79c-46f7-9a9b-e080769f7750 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.489272] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.489409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.489963] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.490176] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11e0074a-e79c-46f7-9a9b-e080769f7750',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.521842] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63: rpc.has_security_group_logging(os_id): False [ 1107.543841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.544072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.544123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.544390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.544529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.544776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.544910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.544996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.545224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.545309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.545499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.545659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.545708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.545940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.545988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.546188] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.546285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.546348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.546486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.546560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.546659] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 is going to be created. [ 1107.582174] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.623210] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.623413] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.623622] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.623882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.624105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.636947] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 in Status: IN_PROGRESS for 2s [ 1107.993017] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.993269] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.993400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.993709] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.993905] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.994026] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 11e0074a-e79c-46f7-9a9b-e080769f7750 not found, creating... [ 1107.994305] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.994485] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.994579] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.994801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.994937] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.995235] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.995387] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.995501] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.995805] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.995985] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.996153] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 11e0074a-e79c-46f7-9a9b-e080769f7750 is going to be created. [ 1108.017610] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.017854] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.017986] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.018309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.018550] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.018791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.088710] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.591010] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.591371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.591371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.591565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.591681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.591791] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1108.636776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.637074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.637074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.637415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.637580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.669051] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1108.789560] env[65660]: INFO networking_nsxv3.common.synchronization [req-d767f554-b6c6-41d3-9e19-a00de135808a req-ce677fef-0307-4d87-acb3-c14483601b09 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1108.789560] env[65660]: INFO networking_nsxv3.common.synchronization [req-d767f554-b6c6-41d3-9e19-a00de135808a req-ce677fef-0307-4d87-acb3-c14483601b09 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1108.789704] env[65660]: INFO networking_nsxv3.common.synchronization [req-d767f554-b6c6-41d3-9e19-a00de135808a req-ce677fef-0307-4d87-acb3-c14483601b09 service nova] Enqueued Resource ID: 11e0074a-e79c-46f7-9a9b-e080769f7750 with Priority: HIGHEST for action port [ 1108.790352] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1108.790568] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1108.790703] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11e0074a-e79c-46f7-9a9b-e080769f7750 with Priority: HIGHEST for action port [ 1108.791019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.791209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.791209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.791423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.791560] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.792661] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.792661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.792802] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-11e0074a-e79c-46f7-9a9b-e080769f7750 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.792900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.792971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.793164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.793242] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11e0074a-e79c-46f7-9a9b-e080769f7750',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.296050] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.296050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.296050] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11e0074a-e79c-46f7-9a9b-e080769f7750 with status ACTIVE [ 1109.296278] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.296278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.296278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.296469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.296554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.296721] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.296819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.296881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.297050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.297129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.297308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.297400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.297459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.297600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.297672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.297755] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11e0074a-e79c-46f7-9a9b-e080769f7750 is going to be updated. [ 1109.318796] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.319006] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.319112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.319347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.319557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.319755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11e0074a-e79c-46f7-9a9b-e080769f7750" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.409922] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 in Status: SUCCESS [ 1109.410201] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 deletion is rescheduled due to dependency. [ 1109.410278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.460526] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c4439c1-5598-498d-9df5-1764b222fa83 req-9a769961-8971-4c10-b0fa-369e1a6ad338 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1109.461271] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1109.461790] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.461790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.461790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.462016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.462194] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.462296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.462357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.462511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.462774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.462774] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.649818] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 in Status: SUCCESS [ 1109.650167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.770064] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.770064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.770248] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.770535] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.770796] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.770956] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.771086] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.771319] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.771487] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.771941] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.771941] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.771941] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.772058] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.772207] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.772242] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.772395] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.792113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.793152] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.793346] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.793566] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.793907] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.794212] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.794212] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.794533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.794677] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4ca7f88-d0ad-45f9-8170-0d750bcb407a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.965755] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.965755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.965755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.965755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.965928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.966046] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.966148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.966213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.966362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.966439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.966523] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1109.992145] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.992297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.992351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.992549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.992692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.001918] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1110.303071] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.303071] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port f4ca7f88-d0ad-45f9-8170-0d750bcb407a not found, creating... [ 1110.303071] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.303071] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.303466] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.303466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.303466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.303857] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.304086] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.304268] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: f4ca7f88-d0ad-45f9-8170-0d750bcb407a is going to be created. [ 1110.330666] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.330892] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.331063] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.331321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.331559] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.331789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.680831] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1110.682150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.682403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.682690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.682930] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.683099] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.683199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.683430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.683608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.683739] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.187701] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.494774] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c4439c1-5598-498d-9df5-1764b222fa83 req-011cde91-6f03-48e3-9900-b49ddbf20be5 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1111.494774] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c4439c1-5598-498d-9df5-1764b222fa83 req-011cde91-6f03-48e3-9900-b49ddbf20be5 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1111.494774] env[65660]: INFO networking_nsxv3.common.synchronization [req-6c4439c1-5598-498d-9df5-1764b222fa83 req-011cde91-6f03-48e3-9900-b49ddbf20be5 service nova] Enqueued Resource ID: f4ca7f88-d0ad-45f9-8170-0d750bcb407a with Priority: HIGHEST for action port [ 1111.494774] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1111.494774] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1111.495134] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ca7f88-d0ad-45f9-8170-0d750bcb407a with Priority: HIGHEST for action port [ 1111.495819] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.496115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.496115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.496308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.496425] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.497666] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.497988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.498392] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.498659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.499333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.499333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.499333] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4ca7f88-d0ad-45f9-8170-0d750bcb407a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.690628] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.993220] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c9f8bbe0-e9ea-415d-a5bc-75c429831c66 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_rules [ 1111.993988] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_rules [ 1111.994377] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.994508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.994575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.994905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.994993] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.001228] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4ca7f88-d0ad-45f9-8170-0d750bcb407a with status ACTIVE [ 1112.001435] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.001555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.001621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.001820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.001909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.002194] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.002370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.002370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.002527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.002827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.003056] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.003188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.003228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.003356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.003430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.003518] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4ca7f88-d0ad-45f9-8170-0d750bcb407a is going to be updated. [ 1112.004681] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.004772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.016079] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1112.016298] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1112.016417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.017039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.017163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.017339] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.017453] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.017516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.017668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.017751] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.017847] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.029228] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.029421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.029421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.029621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.029762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.029932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4ca7f88-d0ad-45f9-8170-0d750bcb407a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.079725] env[65660]: INFO networking_nsxv3.common.synchronization [None req-eef9ec92-7744-4030-98ca-2cdf309a7e4b tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_rules [ 1112.080377] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_rules [ 1112.080711] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.080816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.192324] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.192324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.192324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.192617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.192652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.192913] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1112.227069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.227069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.227069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.227069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.227069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.238878] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1112.517270] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.517458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.517530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.517756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.518267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.518267] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c already deleted. [ 1112.518267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.518267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.518499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.518499] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.519438] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.022471] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.041588] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.041741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.041814] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.042072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.042164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.042255] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c already deleted. [ 1113.042337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.060136] env[65660]: INFO networking_nsxv3.common.synchronization [req-83430924-10c8-4969-a56e-84601b0333c1 req-22b1f2a7-576c-40b0-a978-bed39282ec5e tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1113.060839] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1113.061706] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.061706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.061706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.062100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.062308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.062412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.063058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.063058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.063058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.063058] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.525564] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.525835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.525899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.526148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.526244] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.526344] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1113.568401] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.597432] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.597432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.597432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.597658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.597658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.608595] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1114.070771] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.250585] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 4s [ 1114.575462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.575766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.575894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.576226] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.576372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.576528] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be updated. [ 1114.611643] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.611889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.611889] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.612089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.612240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.623306] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: IN_PROGRESS for 2s [ 1115.619033] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1115.619364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.619364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.620026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.620026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.620026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.620026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.620026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.620248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.620248] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.620248] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.122769] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.124729] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.124729] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.124729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.125830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.125830] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.125830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.125830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.125830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.125830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.125830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.125830] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.335970] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1116.336227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.336425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.336784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.337092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.337232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.337299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.337475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.337557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.337643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.337772] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.628820] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2663bd-4c5a-4280-b2b0-ccd214332642: rpc.has_security_group_logging(os_id): False [ 1116.643794] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1116.643794] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.650463] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.650642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.654025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.654025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.654025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.654025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.654738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.654738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.654738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.654738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.654738] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1116.740838] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.741091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.741273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.741593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.741817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.762152] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1116.840653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.840941] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.841041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.841473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.841723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.841819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.841869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.842078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.842220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.842351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.842560] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.842695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.842763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.842978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.843158] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.843316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.843398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.843797] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.843871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.843959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.844066] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.346203] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1117.379791] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.380040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.380040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.380229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.380317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.380511] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.380611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.380673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.380792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.380873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.381055] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.381151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.381210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.381349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.381418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.381618] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.381707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.381762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.381896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.381964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.382113] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1117.474117] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.474327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.474432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.474749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.476243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.492638] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1118.024764] env[65660]: INFO networking_nsxv3.common.synchronization [req-10280fc5-e3a0-4c5d-a845-412768a751f2 req-35c2a9b7-8eb0-4370-b9e4-aed36f8c859d tempest-AttachInterfacesV270Test-2146283310 tempest-AttachInterfacesV270Test-2146283310-project-member] Enqueued Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_members [ 1118.025322] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGHEST for action security_group_members [ 1118.025743] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.025743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.025842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.028013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.028293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.028462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.028569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.028835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.028967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.029129] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.534537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.534537] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.534537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.534537] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 is going to be updated. [ 1118.579425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.579566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.579638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.579858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.580020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.594894] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 in Status: IN_PROGRESS for 2s [ 1118.777653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1118.777818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.507340] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1119.507646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.605119] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 in Status: SUCCESS [ 1120.605482] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 deletion is rescheduled due to dependency. [ 1120.605564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.986188] env[65660]: INFO networking_nsxv3.common.synchronization [req-827472f1-a0e1-44d3-bd00-a3dac488729a req-cda3eeec-db53-4bfa-b04b-c3cd8a0129d4 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1120.986901] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGHEST for action security_group_members [ 1120.987185] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.987526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.987526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.987624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.987718] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.987818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.987882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.988041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.988175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.988289] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.325411] env[65660]: INFO networking_nsxv3.common.synchronization [req-7da8560e-c19e-4d9b-9239-afb8a4b5ba7f req-2e729d13-5391-46d0-b77c-66e2a06d306d tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_members [ 1121.325910] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_members [ 1121.326579] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.326579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.326579] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.326755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.326788] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.326897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.326974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.327145] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.327236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.327316] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.492793] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.492956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.493042] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.493266] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.493363] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.493563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.493662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.493737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.493892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.493970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.494091] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be updated. [ 1121.522832] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.523062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.523140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.523502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.523502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.533159] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: IN_PROGRESS for 2s [ 1121.654342] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.654342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.654342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.654342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.654342] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.654342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.654342] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.654873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.654873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.654873] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.654956] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.655100] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.655205] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.655302] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.655384] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.655498] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.674300] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.674531] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1121.674706] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.674917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.675339] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-b869f690-b340-4864-a335-d135ab9e00b7 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.675552] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.675700] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.676145] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.676368] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b869f690-b340-4864-a335-d135ab9e00b7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.830648] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.830817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.830869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.831115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.831214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.831431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.831531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.831993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.831993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.831993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.831993] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c already deleted. [ 1121.831993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.179825] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.179977] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.179977] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.180319] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.180537] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.180772] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port b869f690-b340-4864-a335-d135ab9e00b7 not found, creating... [ 1122.181100] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.181455] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.181455] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.181656] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.181810] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.182160] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.182373] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.182479] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.182721] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.182872] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.183030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: b869f690-b340-4864-a335-d135ab9e00b7 is going to be created. [ 1122.205191] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.205402] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.205402] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.205759] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.206272] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.206272] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.950510] env[65660]: INFO networking_nsxv3.common.synchronization [req-7da8560e-c19e-4d9b-9239-afb8a4b5ba7f req-3c33826d-b433-4a8f-9a29-4f92b552200b service nova] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_rules [ 1122.950772] env[65660]: INFO networking_nsxv3.common.synchronization [req-7da8560e-c19e-4d9b-9239-afb8a4b5ba7f req-3c33826d-b433-4a8f-9a29-4f92b552200b service nova] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_members [ 1122.951008] env[65660]: INFO networking_nsxv3.common.synchronization [req-7da8560e-c19e-4d9b-9239-afb8a4b5ba7f req-3c33826d-b433-4a8f-9a29-4f92b552200b service nova] Enqueued Resource ID: b869f690-b340-4864-a335-d135ab9e00b7 with Priority: HIGHEST for action port [ 1122.951554] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_rules [ 1122.951684] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_members [ 1122.951773] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b869f690-b340-4864-a335-d135ab9e00b7 with Priority: HIGHEST for action port [ 1122.952060] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.952192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.952290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.952470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.952567] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.955106] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.955106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.955106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.955106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.955235] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.955290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.955383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.955488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.955573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.955664] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.956438] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b869f690-b340-4864-a335-d135ab9e00b7 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.956548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.956615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.956760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.956836] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b869f690-b340-4864-a335-d135ab9e00b7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.458508] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.459607] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.459724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.460099] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b869f690-b340-4864-a335-d135ab9e00b7 with status ACTIVE [ 1123.460446] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.460446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.460446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.460643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.460717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.460882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.460974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.461039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.461216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.461345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.461540] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.461632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.461691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.461834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.461906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.461992] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b869f690-b340-4864-a335-d135ab9e00b7 is going to be updated. [ 1123.490221] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.490387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.490459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.491047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.491047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.491047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b869f690-b340-4864-a335-d135ab9e00b7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.568910] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de4557e9-9a44-4482-869f-e690653fe59e in Status: SUCCESS [ 1123.569091] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de4557e9-9a44-4482-869f-e690653fe59e deletion is rescheduled due to dependency. [ 1123.569242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.679466] env[65660]: INFO networking_nsxv3.common.synchronization [req-6588317e-4ee2-4393-b4c5-9679f096a19a req-92d87574-7934-48d7-a3ce-8d31757ac92c tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1123.680055] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1123.680381] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.680519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.680575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.680968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.680968] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.681095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.681126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.681470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.681470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.681470] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.962161] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.018915] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.019141] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.019399] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.019714] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.020089] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.020349] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.020514] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.020810] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.020983] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.021259] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.021456] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.021649] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.021822] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.021992] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.022191] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.022363] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.044859] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.045025] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1124.045129] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.045292] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.045659] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-61453d03-bb08-49fa-b37a-d1b203f679f4 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.045920] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.046049] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.046368] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.046506] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61453d03-bb08-49fa-b37a-d1b203f679f4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.183665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.183916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.183977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.184184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.184280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.184485] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.184585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.184633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.184779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.184853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.184937] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1124.216908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.217121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.217208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.217428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.217570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.226261] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1124.465403] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.465568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.465710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.466017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.466120] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.466222] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c is going to be created. [ 1124.491515] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.491682] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.491760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.492025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.492196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.502443] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c in Status: UNINITIALIZED for 2s [ 1124.548910] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.549165] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.549293] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.549615] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.549758] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.549917] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 61453d03-bb08-49fa-b37a-d1b203f679f4 not found, creating... [ 1124.550204] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.550366] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.550484] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.550705] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.550842] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.551146] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.551303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.551408] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.551646] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.551785] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.551923] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 61453d03-bb08-49fa-b37a-d1b203f679f4 is going to be created. [ 1124.572611] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.572877] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.573013] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.573305] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.573541] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.573809] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.811504] env[65660]: INFO networking_nsxv3.common.synchronization [req-7badea17-a165-4e7a-b288-716ddf938b18 req-3496834a-ec68-404d-b5d7-a27626176f6a tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_members [ 1124.812629] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGHEST for action security_group_members [ 1124.813069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.813258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.813366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.813660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.813893] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.814059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.815047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.815047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.815047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.815047] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.319463] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.319791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.319791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.320169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.320169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.320227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.320365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.320365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.320522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.320599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.320687] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f is going to be updated. [ 1125.327458] env[65660]: INFO networking_nsxv3.common.synchronization [req-6588317e-4ee2-4393-b4c5-9679f096a19a req-9d8ebf28-64f6-4db4-8cfc-8ca26da8739a service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 1125.327458] env[65660]: INFO networking_nsxv3.common.synchronization [req-6588317e-4ee2-4393-b4c5-9679f096a19a req-9d8ebf28-64f6-4db4-8cfc-8ca26da8739a service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1125.327458] env[65660]: INFO networking_nsxv3.common.synchronization [req-6588317e-4ee2-4393-b4c5-9679f096a19a req-9d8ebf28-64f6-4db4-8cfc-8ca26da8739a service nova] Enqueued Resource ID: 61453d03-bb08-49fa-b37a-d1b203f679f4 with Priority: HIGHEST for action port [ 1125.328538] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 1125.328708] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1125.328809] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61453d03-bb08-49fa-b37a-d1b203f679f4 with Priority: HIGHEST for action port [ 1125.329127] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.329253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.329364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.329516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.329599] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.330529] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.330632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.330832] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-61453d03-bb08-49fa-b37a-d1b203f679f4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.330933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.330998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.331264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.331340] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61453d03-bb08-49fa-b37a-d1b203f679f4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.365708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.366021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.366021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.366192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.366305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.381289] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: IN_PROGRESS for 2s [ 1125.833367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.833574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.833836] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61453d03-bb08-49fa-b37a-d1b203f679f4 with status ACTIVE [ 1125.834107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.834260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.834352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.834599] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.834703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.834986] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.835188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.835314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.835422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.835515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.835688] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.835783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.835863] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.836054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.836151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.836223] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61453d03-bb08-49fa-b37a-d1b203f679f4 is going to be updated. [ 1125.858724] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.858914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.858953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.859164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.859305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.859467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61453d03-bb08-49fa-b37a-d1b203f679f4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.236821] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1126.236994] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 deletion is rescheduled due to dependency. [ 1126.237050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.237371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.237726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.238016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.238153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.238233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.238508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.238631] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.238735] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.513964] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c in Status: SUCCESS [ 1126.514309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.514365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.514600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.514802] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.514918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.514970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.515158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.515245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.515316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.515423] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.743196] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.018152] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.243889] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.290737] env[65660]: INFO networking_nsxv3.common.synchronization [req-8eb309f8-0d3b-4744-97f2-cd83099331ef req-be243317-2f1f-40dd-8e91-a8490617bf28 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1127.291332] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1127.292282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.293214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.293687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.293687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.293892] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.293987] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.294070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.294249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.294340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.294440] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.392554] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f in Status: SUCCESS [ 1127.392834] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f deletion is rescheduled due to dependency. [ 1127.392917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.520454] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc6d0e84-a7cf-49a8-8525-71f68e22792c: rpc.has_security_group_logging(os_id): False [ 1127.542196] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.542196] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.542196] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.542196] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c is going to be created. [ 1127.598441] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.598561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.598598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.598792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.598970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.608806] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c in Status: IN_PROGRESS for 2s [ 1127.747285] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.747285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.747595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.747595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.747712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.747712] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1127.779985] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.779985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.779985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.779985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.779985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.790972] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1127.796546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.796677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.796744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.796946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.797043] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.797255] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.797372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.797433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.797587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.797684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.797771] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1127.830811] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.830947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.830947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.831404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.831404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.840570] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1128.800577] env[65660]: INFO networking_nsxv3.common.synchronization [req-edda3e1b-360f-4287-9a84-efd12000da0a req-d1042c14-b068-4652-809f-258c3375b07b tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1128.801441] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1128.801762] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.801883] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.801950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.802495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.802619] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.803288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.803288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.803288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.803288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.803288] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.146488] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.146693] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.146816] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.147112] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.147373] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.147529] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.147646] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.147899] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.148251] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.148515] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.148640] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.148743] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.148850] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.148959] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.149098] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.149245] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.172570] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.172746] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.172877] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.173074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.173556] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-89b85334-5bcd-4571-aa31-7463fd1e14c8 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.173747] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.173908] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.174352] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.174426] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b85334-5bcd-4571-aa31-7463fd1e14c8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.304944] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.621317] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c in Status: SUCCESS [ 1129.621548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.678009] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.678331] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.678477] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.678774] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.679101] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.679101] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 89b85334-5bcd-4571-aa31-7463fd1e14c8 not found, creating... [ 1129.679388] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.679546] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.679661] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.679880] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.680026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.680314] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.680468] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.680584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.680789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.681022] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.681097] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 89b85334-5bcd-4571-aa31-7463fd1e14c8 is going to be created. [ 1129.702391] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.702583] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.702717] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.702981] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.703229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.703494] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.805031] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1129.805390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.807018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.807018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.807018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.807018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.807018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.807018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.807328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.807454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.807552] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.809166] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.853071] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1129.853379] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1129.853379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.310993] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.312427] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.312427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.312427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.312931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.313168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.313248] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1130.350729] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.350898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.350946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.351220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.351437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.364779] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1130.432663] env[65660]: INFO networking_nsxv3.common.synchronization [req-edda3e1b-360f-4287-9a84-efd12000da0a req-946c4193-057d-46c3-906a-251996b31ebb service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1130.432922] env[65660]: INFO networking_nsxv3.common.synchronization [req-edda3e1b-360f-4287-9a84-efd12000da0a req-946c4193-057d-46c3-906a-251996b31ebb service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1130.433248] env[65660]: INFO networking_nsxv3.common.synchronization [req-edda3e1b-360f-4287-9a84-efd12000da0a req-946c4193-057d-46c3-906a-251996b31ebb service nova] Enqueued Resource ID: 89b85334-5bcd-4571-aa31-7463fd1e14c8 with Priority: HIGHEST for action port [ 1130.434046] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1130.434250] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1130.434398] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b85334-5bcd-4571-aa31-7463fd1e14c8 with Priority: HIGHEST for action port [ 1130.434703] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.434827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.434896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.435124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.435210] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.436233] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.436360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.436577] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b85334-5bcd-4571-aa31-7463fd1e14c8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.436680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.436775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.436971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.437112] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b85334-5bcd-4571-aa31-7463fd1e14c8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.527962] env[65660]: INFO networking_nsxv3.common.synchronization [None req-a59d0400-3cf9-4728-89b6-ce621b027c4a None None] Enqueued Resource ID: 18d44ac6-e726-46cd-bdab-eb715951cf22 with Priority: HIGHEST for action port [ 1130.528655] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d44ac6-e726-46cd-bdab-eb715951cf22 with Priority: HIGHEST for action port [ 1130.528989] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d44ac6-e726-46cd-bdab-eb715951cf22 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.529131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d44ac6-e726-46cd-bdab-eb715951cf22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.529202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d44ac6-e726-46cd-bdab-eb715951cf22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.529635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d44ac6-e726-46cd-bdab-eb715951cf22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.529770] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d44ac6-e726-46cd-bdab-eb715951cf22',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.757903] env[65660]: INFO networking_nsxv3.common.synchronization [None req-f4b37c0e-0f01-4c0e-8717-5c724d98ba45 tempest-AttachInterfacesTestJSON-415676740 tempest-AttachInterfacesTestJSON-415676740-project-member] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1130.757903] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGHEST for action security_group_members [ 1130.757903] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.757903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.757903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.758246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.759360] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.759630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.759877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.760163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.760343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.760520] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.815645] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f149ebe9-de13-482c-885e-b787b9881cd4: rpc.has_security_group_logging(os_id): False [ 1130.838862] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.838862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.838862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.839085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.839208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.841646] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.841646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.841646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.841646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.841646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.841646] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1130.907013] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.907193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.907265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.907505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.907703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.927740] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1130.939521] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.939675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.939983] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b85334-5bcd-4571-aa31-7463fd1e14c8 with status ACTIVE [ 1130.940238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.940366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.940470] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.940702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.940879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.941164] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.941286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.941447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.941696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.941826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.942092] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.942280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.942280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.942490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.942594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.942718] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b85334-5bcd-4571-aa31-7463fd1e14c8 is going to be updated. [ 1130.966033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.966210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.966261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.966832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.966832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.966832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b85334-5bcd-4571-aa31-7463fd1e14c8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.032527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18d44ac6-e726-46cd-bdab-eb715951cf22 [ 1131.032527] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.032527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.032688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.032956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.032956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.033236] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18d44ac6-e726-46cd-bdab-eb715951cf22 already deleted. [ 1131.033236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d44ac6-e726-46cd-bdab-eb715951cf22" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.265916] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.266740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.266740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.266740] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.269039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.269039] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.269039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.269039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.269039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.269039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.269039] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be updated. [ 1131.312211] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.312211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.312211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.312211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.312211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.325801] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: IN_PROGRESS for 2s [ 1132.377826] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.377826] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.377826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.377826] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.880659] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.941212] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1132.941433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.341411] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb in Status: SUCCESS [ 1133.341536] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb deletion is rescheduled due to dependency. [ 1133.341655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.382737] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.671767] env[65660]: INFO networking_nsxv3.common.synchronization [None req-aeb3e28f-5475-412b-b4d9-00e59e781c1b None None] Enqueued Resource ID: 2be824af-d0ba-469d-8af9-5a39e73ff2a6 with Priority: HIGHEST for action port [ 1133.672821] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2be824af-d0ba-469d-8af9-5a39e73ff2a6 with Priority: HIGHEST for action port [ 1133.672866] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2be824af-d0ba-469d-8af9-5a39e73ff2a6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.672968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2be824af-d0ba-469d-8af9-5a39e73ff2a6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.673071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2be824af-d0ba-469d-8af9-5a39e73ff2a6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.673701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2be824af-d0ba-469d-8af9-5a39e73ff2a6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.673701] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2be824af-d0ba-469d-8af9-5a39e73ff2a6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.888913] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.888913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.888913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.888913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.888913] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.888913] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1133.917835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.917982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.918069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.918288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.918435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.929013] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1134.177425] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2be824af-d0ba-469d-8af9-5a39e73ff2a6 [ 1134.177958] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.178255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.178355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.178614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.178708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.178851] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2be824af-d0ba-469d-8af9-5a39e73ff2a6 already deleted. [ 1134.178957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2be824af-d0ba-469d-8af9-5a39e73ff2a6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.940904] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1135.941308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.941394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.941626] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.941818] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.941935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.941996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.942180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.942264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.942441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.942548] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.445165] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.445319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.445403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.445676] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.446101] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.446101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.446101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.446271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.446340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.446477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.446618] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.446721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.446817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.446920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.447090] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.447218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.447291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.447423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.447497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.447571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.447658] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.950081] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1136.967290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.967452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.967517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.967735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.967823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.968028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.968128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.968190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.968373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.968476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.968614] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.968705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.968763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.968897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.968967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.969179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.969276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.969336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.969471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.969543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.969627] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1137.030136] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.030136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.030136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.030136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.030136] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.043371] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1138.673907] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.674329] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1139.059127] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1139.059465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.336166] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bad2f66-31f6-40b7-a4e9-e049811a87de req-5dfd707e-93b3-4eac-9b77-637cb751544a tempest-ServerAddressesNegativeTestJSON-1536657904 tempest-ServerAddressesNegativeTestJSON-1536657904-project-member] Enqueued Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_members [ 1139.336879] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_members [ 1139.337233] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.337360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.337434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.337697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.337870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.339018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.339018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.339018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.339018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.339018] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.636962] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-788 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.637231] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-788" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.637409] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-788" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.637716] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-788" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.637981] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.638151] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.638268] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.638481] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.638618] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.638822] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1139.638933] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.639054] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.639162] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.639270] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1139.639373] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.639502] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.658722] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.658863] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1139.658931] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.659122] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-788" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.659436] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-372349d6-095a-4fd9-8dc3-e34b765e8155 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.659602] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.659752] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.660051] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.660198] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('372349d6-095a-4fd9-8dc3-e34b765e8155',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.840325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.840726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.840726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.841037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.841232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.841506] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.841657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.841751] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.841965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.842098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.842239] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 already deleted. [ 1139.842367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.162746] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.163213] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.163522] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.164061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.164300] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.164473] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 372349d6-095a-4fd9-8dc3-e34b765e8155 not found, creating... [ 1140.164751] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.164914] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.165061] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.165301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.165468] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.165783] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.165942] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.166134] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.166364] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.166503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.166650] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 372349d6-095a-4fd9-8dc3-e34b765e8155 is going to be created. [ 1140.187865] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.188110] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.190593] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.191017] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.191357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.191667] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.896373] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bad2f66-31f6-40b7-a4e9-e049811a87de req-22c2253c-5238-471a-a58a-c84e360e575f service nova] Enqueued Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_rules [ 1140.896684] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bad2f66-31f6-40b7-a4e9-e049811a87de req-22c2253c-5238-471a-a58a-c84e360e575f service nova] Enqueued Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_members [ 1140.896684] env[65660]: INFO networking_nsxv3.common.synchronization [req-6bad2f66-31f6-40b7-a4e9-e049811a87de req-22c2253c-5238-471a-a58a-c84e360e575f service nova] Enqueued Resource ID: 372349d6-095a-4fd9-8dc3-e34b765e8155 with Priority: HIGHEST for action port [ 1140.897216] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_rules [ 1140.897342] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_members [ 1140.897436] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372349d6-095a-4fd9-8dc3-e34b765e8155 with Priority: HIGHEST for action port [ 1140.897744] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.897819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.897886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.898566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.898650] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.899625] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.899702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.899738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.899910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.900124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.900211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.900250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.900389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.900475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.900598] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.901981] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-372349d6-095a-4fd9-8dc3-e34b765e8155 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.901981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.903034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.903356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.903531] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('372349d6-095a-4fd9-8dc3-e34b765e8155',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.167355] env[65660]: INFO networking_nsxv3.common.synchronization [req-418ed56c-a96b-4f32-915a-20fbed197d70 req-23b917c5-7f3f-4f98-890c-2c6f5a3d53dc tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1141.167960] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1141.168597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.168597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.168735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.168991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.169287] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.169352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.169441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.169617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.169710] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.169798] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.407649] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.407778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.407985] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.408864] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 372349d6-095a-4fd9-8dc3-e34b765e8155 with status ACTIVE [ 1141.409070] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.409188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.409254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.409466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.409554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.409727] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.409826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.409900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.410069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.410153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.410329] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.410412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.410493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.410608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.410737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.410783] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 372349d6-095a-4fd9-8dc3-e34b765e8155 is going to be updated. [ 1141.431933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.432166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.432166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.432329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.432507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.432670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-372349d6-095a-4fd9-8dc3-e34b765e8155" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.580229] env[65660]: INFO networking_nsxv3.common.synchronization [req-f2c42c55-59d5-4d29-85a5-fb4c95133085 req-63ec9688-ff02-480a-a0fc-eb81ae017689 tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 1141.580772] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 1141.581084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.581209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.581281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.581478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.581629] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.581724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.581785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.581928] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.582016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.582107] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.672109] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.896229] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.896452] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.896688] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.896861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.897213] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.897374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.897490] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.897707] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.897847] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.898069] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.898181] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.898290] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.898395] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.898502] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.898603] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.898731] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.912768] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.918221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.918315] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.918504] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.919167] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.919167] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-3ab98db8-9676-494e-8b74-2bc30a265076 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.919167] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.919400] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.919701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.919839] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab98db8-9676-494e-8b74-2bc30a265076',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.084608] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.084860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.084989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.085303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.085444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.085656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.085773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.085836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.086017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.086072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.086235] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be deleted. [ 1142.164621] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.164762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.164834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.165068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.165168] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.165270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.174908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.415304] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.415545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.415684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.416173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.416340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.416501] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 is going to be created. [ 1142.422990] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.423369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.423634] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.424074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.424347] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.424616] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 3ab98db8-9676-494e-8b74-2bc30a265076 not found, creating... [ 1142.425110] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.425355] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.425591] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.425942] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.426256] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.426732] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.427007] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.427253] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.427598] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.427861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.428281] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 3ab98db8-9676-494e-8b74-2bc30a265076 is going to be created. [ 1142.443451] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.443697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.443822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.444134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.444259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.450578] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.451152] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.451152] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.451328] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.451519] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.451757] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.455522] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 in Status: UNINITIALIZED for 2s [ 1142.677834] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.678105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.678451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.678768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.678884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.678992] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1142.708699] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.708887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.708956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.709144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.709472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.722040] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1143.615022] env[65660]: INFO networking_nsxv3.common.synchronization [req-f2c42c55-59d5-4d29-85a5-fb4c95133085 req-9dc721d9-4fa0-428b-b187-074c9e6d5435 service nova] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_rules [ 1143.615351] env[65660]: INFO networking_nsxv3.common.synchronization [req-f2c42c55-59d5-4d29-85a5-fb4c95133085 req-9dc721d9-4fa0-428b-b187-074c9e6d5435 service nova] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 1143.615405] env[65660]: INFO networking_nsxv3.common.synchronization [req-f2c42c55-59d5-4d29-85a5-fb4c95133085 req-9dc721d9-4fa0-428b-b187-074c9e6d5435 service nova] Enqueued Resource ID: 3ab98db8-9676-494e-8b74-2bc30a265076 with Priority: HIGHEST for action port [ 1143.615936] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_rules [ 1143.616170] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 1143.616281] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab98db8-9676-494e-8b74-2bc30a265076 with Priority: HIGHEST for action port [ 1143.616769] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.616769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.616769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.616952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.616952] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.618446] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.618446] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.618571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.618729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.618859] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.618964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.619153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.619191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.619265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.619378] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.621437] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab98db8-9676-494e-8b74-2bc30a265076 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.621437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.621437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.621437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.621437] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab98db8-9676-494e-8b74-2bc30a265076',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.917016] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe9d6d57-9dd9-4d4d-995c-7885fc308710 req-d83230ba-ddc9-4c1c-82eb-d9fc7392f05e tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1143.917541] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1143.917849] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.917971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.918935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.920815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.921009] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.921423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.921423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.921423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.921423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.921561] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.122893] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.123276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.123440] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.125975] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ab98db8-9676-494e-8b74-2bc30a265076 with status ACTIVE [ 1144.125975] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.125975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.125975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.125975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.125975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.125975] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.125975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.126509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.126509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.126509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.126798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.126958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.127089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.127321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.127451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.127586] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ab98db8-9676-494e-8b74-2bc30a265076 is going to be updated. [ 1144.151413] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.151629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.151694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.151887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.152040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.152231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.203647] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.203868] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.203994] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.204324] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.204604] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.204827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.204975] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.205261] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.205432] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.205657] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.205791] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.205928] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.206050] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.206239] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.206402] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.206604] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.235341] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.235515] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1144.235633] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.235823] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.236234] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-506fd470-b5e7-45f2-8deb-7333ec788e06 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.236429] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.236561] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.236924] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.237099] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('506fd470-b5e7-45f2-8deb-7333ec788e06',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.423828] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.424046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.424204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.424480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.424613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.424865] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.425102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.425162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.425326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.425429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.425541] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1144.452499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.452685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.452725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.452914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.453079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.464376] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1144.465073] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 in Status: SUCCESS [ 1144.465317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.465588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.465694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.465890] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.465998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.466074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.466299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.466370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.466458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.466549] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.631444] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.732707] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1144.732958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.739720] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.739916] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.740028] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.740334] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.740470] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.740646] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 506fd470-b5e7-45f2-8deb-7333ec788e06 not found, creating... [ 1144.740946] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.741120] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.741241] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.741468] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.741599] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.741877] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.742039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.742160] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.742365] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.742499] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.742637] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 506fd470-b5e7-45f2-8deb-7333ec788e06 is going to be created. [ 1144.762934] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.763181] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.763309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.763609] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.763828] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.764452] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.969335] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.971282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.971282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.971739] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.971739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.971739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.971739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.971858] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.971954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.971999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.972154] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.972242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.972298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.972391] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.136556] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.136862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.137036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.137441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.137597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.137808] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be created. [ 1145.163880] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.164100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.164172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.164457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.164641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.176320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: UNINITIALIZED for 2s [ 1145.475207] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb098160-f09b-4c92-93a4-fb3bb43d9826: rpc.has_security_group_logging(os_id): False [ 1145.490605] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe9d6d57-9dd9-4d4d-995c-7885fc308710 req-be7fa0aa-6fc0-496a-acac-e42152601323 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1145.490796] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe9d6d57-9dd9-4d4d-995c-7885fc308710 req-be7fa0aa-6fc0-496a-acac-e42152601323 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1145.490942] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe9d6d57-9dd9-4d4d-995c-7885fc308710 req-be7fa0aa-6fc0-496a-acac-e42152601323 service nova] Enqueued Resource ID: 506fd470-b5e7-45f2-8deb-7333ec788e06 with Priority: HIGHEST for action port [ 1145.491553] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1145.491631] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1145.491731] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506fd470-b5e7-45f2-8deb-7333ec788e06 with Priority: HIGHEST for action port [ 1145.492016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.492144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.492205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.492440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.492521] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.493402] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.493504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.493697] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-506fd470-b5e7-45f2-8deb-7333ec788e06 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.493792] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.493857] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.494041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.494122] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('506fd470-b5e7-45f2-8deb-7333ec788e06',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.502143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.502324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.502371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.502575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.502679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.502884] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.502999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.503141] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.503336] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.503428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.503663] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.503772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.503849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.504014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.504108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.504322] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.504845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.504845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.504940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.505078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.505177] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 is going to be created. [ 1145.566748] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.566959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.567311] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.567499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.567774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.579545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 in Status: IN_PROGRESS for 2s [ 1145.996336] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.996684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.996684] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 506fd470-b5e7-45f2-8deb-7333ec788e06 with status ACTIVE [ 1145.996825] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.996932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.996992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.997245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.997346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.997494] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.997587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.997644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.997795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.997872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.998069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.998177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.998229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.998381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.998501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.998548] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 506fd470-b5e7-45f2-8deb-7333ec788e06 is going to be updated. [ 1146.022030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.022030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.022030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.022030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.022030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.022030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-506fd470-b5e7-45f2-8deb-7333ec788e06" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.474980] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1146.475184] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1146.475392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.475610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.475881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.476110] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.476285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.476400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.476597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.476708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.476824] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.979640] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.187245] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: SUCCESS [ 1147.187644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.187644] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.187896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.188134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.188269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.188348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.188530] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.188641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.188729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.188820] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.482910] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.593215] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 in Status: SUCCESS [ 1147.593443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.691014] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.691200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.691277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.691461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.691628] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.691729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.691795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.691946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.692056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.692160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.692308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.692402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.692461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.692601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.692736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.692844] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.692940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.693032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.693124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.693206] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.693295] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.819276] env[65660]: INFO networking_nsxv3.common.synchronization [req-304a4db3-054f-4174-922e-81cd93a62b8b req-05ac0bc3-bd13-4852-8eda-dca12d9005fa tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1147.819667] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1147.819795] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.819852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.819923] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.820104] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.820265] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.820367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.820424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.820575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.820658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.820751] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.987849] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.988615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.988615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.988813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.988813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.988962] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1148.023684] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.023843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.023891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.024216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.024277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.033684] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1148.196760] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b604088e-8278-4c35-a94f-fc57fbebf7a4: rpc.has_security_group_logging(os_id): False [ 1148.215747] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.215955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.215955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.216284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.216412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.216637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.216738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.216815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.216985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.217073] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.218951] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.218951] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.218951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.218951] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be created. [ 1148.283609] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.283767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.283839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.284151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.284341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.296431] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: IN_PROGRESS for 2s [ 1148.323584] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.825952] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.329336] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.329655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.329655] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.329785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.329875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.329973] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1149.363342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.363543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.363633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.363852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.364008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.373786] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1150.044288] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1150.044595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.044798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.045049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.045271] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.045400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.045462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.045634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.045717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.045803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.045899] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.311243] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: SUCCESS [ 1150.311315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.548729] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.549144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.549144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.549224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.549357] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.549459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.549524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.549670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.549758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.549843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.549985] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.550115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.550177] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.550321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.550462] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.550553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.550613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.550752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.550826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.550904] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.550990] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.053309] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2663bd-4c5a-4280-b2b0-ccd214332642: rpc.has_security_group_logging(os_id): False [ 1151.075908] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.076133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.076181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.076474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.076576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.076832] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.076959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.077058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.077190] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.077302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.077476] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.077568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.077629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.077771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.077845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.078081] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.078179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.078257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.078426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.078501] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.078685] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1151.151290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.151377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.151479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.151784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.151942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.168729] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1151.384940] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1151.385124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.544047] env[65660]: INFO networking_nsxv3.common.synchronization [req-e97c6a25-6e8d-463e-a066-f1ed9a75862d req-1d8bf217-2a27-4959-99d1-fa4113d522cb tempest-ServerAddressesNegativeTestJSON-1536657904 tempest-ServerAddressesNegativeTestJSON-1536657904-project-member] Enqueued Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_members [ 1151.544645] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGHEST for action security_group_members [ 1151.544937] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.545084] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.545178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.545361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.545597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.545597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.545784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.545816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.545877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.545971] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.048798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.049260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.049260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.049427] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.049550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.049821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.049993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.049993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.050166] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.050263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.050435] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 is going to be updated. [ 1152.082131] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.082320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.082374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.082573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.082716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.091859] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 in Status: IN_PROGRESS for 2s [ 1152.741711] env[65660]: INFO networking_nsxv3.common.synchronization [req-29853981-9850-4878-b4d0-89eaffa89920 req-158adc7e-a02b-4e21-a907-0f18bb4203bd tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 1152.742513] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGHEST for action security_group_members [ 1152.742513] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.742513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.742513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.743654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.743654] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.743654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.743654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.743654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.743654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.743654] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.785178] env[65660]: INFO networking_nsxv3.common.synchronization [req-29853981-9850-4878-b4d0-89eaffa89920 req-158adc7e-a02b-4e21-a907-0f18bb4203bd tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 3ab98db8-9676-494e-8b74-2bc30a265076 with Priority: HIGHEST for action port [ 1152.785853] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab98db8-9676-494e-8b74-2bc30a265076 with Priority: HIGHEST for action port [ 1152.786180] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab98db8-9676-494e-8b74-2bc30a265076 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.786360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.786598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.786820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.787221] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab98db8-9676-494e-8b74-2bc30a265076',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.185973] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1153.186442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.246174] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.246421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.246421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.246699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.246818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.247023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.247191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.247269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.247451] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.247531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.247618] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be updated. [ 1153.280539] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.280737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.280799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.280969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.281129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.288801] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ab98db8-9676-494e-8b74-2bc30a265076 with status ACTIVE [ 1153.289025] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.289153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.289221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.289431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.289569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.289841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.290139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.290396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.290532] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.290824] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.291128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.291437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.291505] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.291657] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ab98db8-9676-494e-8b74-2bc30a265076 is going to be updated. [ 1153.293300] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: IN_PROGRESS for 2s [ 1153.312650] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.312834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.312875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.313075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.313208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.313368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab98db8-9676-494e-8b74-2bc30a265076" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.103433] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 in Status: SUCCESS [ 1154.103755] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 deletion is rescheduled due to dependency. [ 1154.103946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.388518] env[65660]: INFO networking_nsxv3.common.synchronization [req-e704fdd5-163f-4c1c-8d9d-fb5700ac8a3b req-bf771848-9568-43ad-b3bf-2d5583b64445 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_members [ 1154.389458] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGHEST for action security_group_members [ 1154.389882] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.390766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.390906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.391203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.391429] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.391634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.391721] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.391881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.391968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.392729] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.896535] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.896702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.896773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.897014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.897111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.897327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.897519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.897519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.897623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.897696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.897779] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 332826ee-e169-4398-8162-f86ad56e690d is going to be updated. [ 1154.929411] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.929604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.929664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.929901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.930085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.941168] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 332826ee-e169-4398-8162-f86ad56e690d in Status: IN_PROGRESS for 2s [ 1155.305156] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 in Status: SUCCESS [ 1155.305312] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 deletion is rescheduled due to dependency. [ 1155.305538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.951226] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 332826ee-e169-4398-8162-f86ad56e690d in Status: SUCCESS [ 1156.951635] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 332826ee-e169-4398-8162-f86ad56e690d deletion is rescheduled due to dependency. [ 1156.951635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.940577] env[65660]: INFO networking_nsxv3.common.synchronization [req-66b2d658-4539-48bb-972d-c4c2168769b5 req-7fcec100-cb74-47a5-a5fb-94019ff647ac tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1157.941142] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1157.941452] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.941575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.941641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.941856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.942016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.942113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.942174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.942318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.942402] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.942496] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.254041] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.254380] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.254483] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.254759] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.255024] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.255184] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.255302] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.255515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.255660] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.255874] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.255992] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.256105] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.256204] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.256315] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.256436] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.256572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.276605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.276825] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1158.276991] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.277224] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.277595] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.277805] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.277956] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.278341] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.278520] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43434a47-29b6-4ff8-9a7a-bbc77f8d362a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.444460] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.661517] env[65660]: INFO networking_nsxv3.common.synchronization [req-d7354445-cae6-46ca-a7e6-c5ae46184665 req-e1043cd4-6b69-447d-9c59-4199dfd58f56 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1158.662169] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1158.662507] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.663487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.663487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.663659] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.663789] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.663906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.663974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.664251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.664667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.664779] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.782018] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.782018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.782018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.782018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.782018] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.782344] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 43434a47-29b6-4ff8-9a7a-bbc77f8d362a not found, creating... [ 1158.782344] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.782563] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.782596] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.782809] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.783054] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.783233] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.783383] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.783498] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.784301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.784301] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.784301] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 43434a47-29b6-4ff8-9a7a-bbc77f8d362a is going to be created. [ 1158.806568] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.806792] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.806901] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.807212] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.807464] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.807688] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.947665] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.170362] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.170526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.170624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.170955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.171109] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.171358] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.171476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.171550] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.171696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.171775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.171861] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1159.220405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.220636] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.220699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.220943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.221107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.236991] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1159.452190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.452552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.452552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.452737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.452840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.452949] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1159.486559] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.486708] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.486804] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.486993] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.487158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.497182] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1159.536859] env[65660]: INFO networking_nsxv3.common.synchronization [req-66b2d658-4539-48bb-972d-c4c2168769b5 req-b8202db2-3102-4ad0-8400-931c6c7ca103 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1159.537321] env[65660]: INFO networking_nsxv3.common.synchronization [req-66b2d658-4539-48bb-972d-c4c2168769b5 req-b8202db2-3102-4ad0-8400-931c6c7ca103 service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1159.537321] env[65660]: INFO networking_nsxv3.common.synchronization [req-66b2d658-4539-48bb-972d-c4c2168769b5 req-b8202db2-3102-4ad0-8400-931c6c7ca103 service nova] Enqueued Resource ID: 43434a47-29b6-4ff8-9a7a-bbc77f8d362a with Priority: HIGHEST for action port [ 1159.537741] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1159.537880] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1159.537977] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43434a47-29b6-4ff8-9a7a-bbc77f8d362a with Priority: HIGHEST for action port [ 1159.538276] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.538447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.538447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.538686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.538769] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.539775] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.539775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.540596] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.540596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.540596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.540596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.540596] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43434a47-29b6-4ff8-9a7a-bbc77f8d362a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.042088] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.042315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.042397] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43434a47-29b6-4ff8-9a7a-bbc77f8d362a with status ACTIVE [ 1160.042564] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.042668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.042718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.042944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.043032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.043210] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.043297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.043352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.043511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.043595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.043749] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.043900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.043900] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.044053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.044126] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.044208] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43434a47-29b6-4ff8-9a7a-bbc77f8d362a is going to be updated. [ 1160.067142] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.067335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.067430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.067594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.067737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.067897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43434a47-29b6-4ff8-9a7a-bbc77f8d362a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.247137] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1161.247137] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1161.247137] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.509202] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1161.509482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.510892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.510892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.510892] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.510892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.510892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.510892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.510892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.510892] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.014904] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.517140] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.021048] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.021048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.021048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.021048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.021048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.021048] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1163.052744] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.052958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.053092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.053396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.053623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.064020] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1164.539088] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1164.539574] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1165.075474] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1165.075677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.075851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.076091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.076289] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.076437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.076533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.076697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.076775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.076861] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.076952] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.580091] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.580563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.580563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.580681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.580818] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.580996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.581092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.581290] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.581410] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.581524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.581703] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.581835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.581917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.582102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.582274] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.582391] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.582473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.582641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.582739] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.582843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.582954] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.085485] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1166.103438] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.103652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.103652] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.103847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.103965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.104207] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.104321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.104438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.104613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.104701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.104923] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.105063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.105134] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.105324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.105409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.105650] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.105771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.105834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.106021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.106118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.106219] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1166.167376] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.167575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.167627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.167830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.168041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.182579] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1168.203307] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1168.203926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.281393] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb810eea-cd4f-4baa-aab8-dafb51ef9628 req-1dfccdc8-c77c-4eac-92f9-0f4a704933b9 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1168.282053] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1168.282374] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.282497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.282642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.282858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.282974] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.283131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.283199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.283349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.283433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.283569] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.581334] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.581656] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.581860] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.582176] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.582443] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.582601] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.582781] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.582948] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.583107] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.583318] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.583430] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.583563] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.583645] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.583751] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.583856] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.583985] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.616709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.616996] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.617202] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.617449] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-725" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.617783] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.617984] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.618266] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.618676] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.618873] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2a7ad-9d3e-4421-8a5f-ff69040844b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.786065] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.786282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.786375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.786782] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.786894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.787138] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.787242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.787304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.787491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.787574] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.787666] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1168.816259] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.816552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.816650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.816874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.817056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.826199] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1169.122048] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.122373] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.122515] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.122802] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.122958] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.123122] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 not found, creating... [ 1169.123389] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.123543] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.123662] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.123884] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.124034] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.124319] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.124511] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.124668] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.124929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.125020] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.125161] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 is going to be created. [ 1169.149820] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.150136] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.150260] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.150581] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.150860] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.151647] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.425697] env[65660]: INFO networking_nsxv3.common.synchronization [req-f993629f-6b05-475d-9324-480b4db2fc41 req-fd06a685-edca-4dd2-b0e0-e052caf35b8e tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1169.426761] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1169.427213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.427349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.427497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.427702] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.427869] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.427970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.428045] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.428200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.428289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.428385] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.931112] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.273203] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb810eea-cd4f-4baa-aab8-dafb51ef9628 req-3ca8e2d5-a866-4192-9734-7bb353039507 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1170.273443] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb810eea-cd4f-4baa-aab8-dafb51ef9628 req-3ca8e2d5-a866-4192-9734-7bb353039507 service nova] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1170.273634] env[65660]: INFO networking_nsxv3.common.synchronization [req-cb810eea-cd4f-4baa-aab8-dafb51ef9628 req-3ca8e2d5-a866-4192-9734-7bb353039507 service nova] Enqueued Resource ID: 2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 with Priority: HIGHEST for action port [ 1170.274554] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_rules [ 1170.274747] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1170.274891] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 with Priority: HIGHEST for action port [ 1170.275335] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.275539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.275697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.275966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.276116] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.277430] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.277430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.278169] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.278375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.278482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.278723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.278891] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2a7ad-9d3e-4421-8a5f-ff69040844b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.433500] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.780927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.781058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781243] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 with status ACTIVE [ 1170.781418] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.781528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.781831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.781921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.782107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.782204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.782265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.782411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.782487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.782666] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.782761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.782819] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.782954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.783102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.783192] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ec2a7ad-9d3e-4421-8a5f-ff69040844b1 is going to be updated. [ 1170.806099] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.806324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.806324] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.806561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.806713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.806873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec2a7ad-9d3e-4421-8a5f-ff69040844b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.835574] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1170.835774] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1170.835823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.835981] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.836210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.836396] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.836557] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.836625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.836783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.836862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.836959] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.936424] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.936684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.936748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.936991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.937125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.937232] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1170.965283] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.965578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.965669] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.965892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.966051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.983157] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1171.338901] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.842055] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.344776] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.345072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.345112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.345465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.345593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.345758] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1172.380722] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.380936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.381050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.381496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.381705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.390545] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1172.994414] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1172.994950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.402534] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1174.402867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.403105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.403412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.403682] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.403842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.403936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.404162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.404268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.404383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.404537] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.909415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.909610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.909610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.909894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.910134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.910272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.910364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.910577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.910719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.910834] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.911031] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.911156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.911202] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.911378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.911546] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.911665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.911742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.911882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.911978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.912046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.912138] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.276437] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1175.276654] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1175.414258] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2663bd-4c5a-4280-b2b0-ccd214332642: rpc.has_security_group_logging(os_id): False [ 1175.434034] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.434199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.434241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.434458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.434513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.434719] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.435033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.435033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.435123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.435123] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.435301] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.435395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.435454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.435602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.435704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.435916] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.436046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.436096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.436245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.436318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.436402] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1175.503390] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.503821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.503821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.503960] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.504124] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.522409] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1177.540477] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1177.540909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.935937] env[65660]: INFO networking_nsxv3.common.synchronization [req-a5007dce-7650-44d1-bb25-e5d959e553c4 req-afe35aee-c330-43b4-8783-4ac40460db0b tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1177.936756] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1177.937176] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.937307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.937374] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.937614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.937737] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.937827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.937884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.938341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.938341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.938341] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.354234] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.354501] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.354698] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.355010] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.355320] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.355523] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.355680] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.356022] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.356254] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.356553] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.356778] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.356895] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.357022] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.357160] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.357295] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.357435] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.377881] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.378115] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.378259] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.378438] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-751" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.378753] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-2b703c23-9147-41fc-90d4-41ad298a6c4c taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.378995] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.379138] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.379468] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.379609] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b703c23-9147-41fc-90d4-41ad298a6c4c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.440437] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.882346] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.882746] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.882955] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.883341] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.883506] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.883668] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 2b703c23-9147-41fc-90d4-41ad298a6c4c not found, creating... [ 1178.883964] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.884141] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.884264] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.884535] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.884698] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.884985] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.885164] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.885281] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.885484] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.885617] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.885755] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 2b703c23-9147-41fc-90d4-41ad298a6c4c is going to be created. [ 1178.909505] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.909773] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.909908] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.910220] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.910503] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.910737] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945307] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.447812] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.447977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.448050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.448276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.448450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.448490] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be updated. [ 1179.478163] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.478163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.478163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.478299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.478383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.489579] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: IN_PROGRESS for 2s [ 1179.653710] env[65660]: INFO networking_nsxv3.common.synchronization [req-a5007dce-7650-44d1-bb25-e5d959e553c4 req-78608dc3-3a04-4fc9-96d8-1d9df4e25a57 service nova] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 1179.653864] env[65660]: INFO networking_nsxv3.common.synchronization [req-a5007dce-7650-44d1-bb25-e5d959e553c4 req-78608dc3-3a04-4fc9-96d8-1d9df4e25a57 service nova] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1179.654017] env[65660]: INFO networking_nsxv3.common.synchronization [req-a5007dce-7650-44d1-bb25-e5d959e553c4 req-78608dc3-3a04-4fc9-96d8-1d9df4e25a57 service nova] Enqueued Resource ID: 2b703c23-9147-41fc-90d4-41ad298a6c4c with Priority: HIGHEST for action port [ 1179.654263] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_rules [ 1179.654393] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1179.654500] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b703c23-9147-41fc-90d4-41ad298a6c4c with Priority: HIGHEST for action port [ 1179.655108] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.655254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.655289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.655520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.655584] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.656975] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.657143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.657379] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b703c23-9147-41fc-90d4-41ad298a6c4c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.657492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.657578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.657791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.657902] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b703c23-9147-41fc-90d4-41ad298a6c4c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.159926] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.160307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.160456] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b703c23-9147-41fc-90d4-41ad298a6c4c with status ACTIVE [ 1180.160657] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.160788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.160912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.161229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.161326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.161614] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.161769] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.161835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.162106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.162353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.162755] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.162755] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.162906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.162967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.163101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.163240] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b703c23-9147-41fc-90d4-41ad298a6c4c is going to be updated. [ 1180.188889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.189539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.189539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.189539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.189539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.189742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b703c23-9147-41fc-90d4-41ad298a6c4c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.350102] env[65660]: INFO networking_nsxv3.common.synchronization [req-7e7c0e0b-08b7-4cda-bef4-ef9d361f5fd6 req-5b762fca-c1a8-4ef7-aff3-0e84bf61f6f2 tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1180.350901] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1180.351325] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.351519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.351630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.351911] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.352133] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.352300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.352404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.352606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.352742] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.352879] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.691688] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.691902] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.692038] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.692316] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.692575] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.692734] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.692850] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.693076] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.693225] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.693463] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.693532] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.693639] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.693748] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.693856] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.693975] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.694122] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.712451] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.712639] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1180.712807] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.713036] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-281" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.713374] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.713548] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.713670] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.714013] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.714157] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.854787] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.217614] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.218309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.218309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.218309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.218415] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.218526] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 not found, creating... [ 1181.218951] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.219042] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.219192] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.219464] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.219619] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.219933] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.220107] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.220244] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.220473] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.220608] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.220764] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 is going to be created. [ 1181.243715] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.244068] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.244275] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.245898] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.245898] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.245898] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.357575] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.499492] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 1181.499713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.499878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.500110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.500440] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.500440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.500569] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.500625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.500690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.500785] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.862571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.862571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.862571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.862571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.862571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.862571] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1181.895020] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.895020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.895020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.895020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.895020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.903931] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1181.944702] env[65660]: INFO networking_nsxv3.common.synchronization [req-7e7c0e0b-08b7-4cda-bef4-ef9d361f5fd6 req-67c2f293-5eaa-4848-ab33-c98843ec914a service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1181.945007] env[65660]: INFO networking_nsxv3.common.synchronization [req-7e7c0e0b-08b7-4cda-bef4-ef9d361f5fd6 req-67c2f293-5eaa-4848-ab33-c98843ec914a service nova] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1181.945240] env[65660]: INFO networking_nsxv3.common.synchronization [req-7e7c0e0b-08b7-4cda-bef4-ef9d361f5fd6 req-67c2f293-5eaa-4848-ab33-c98843ec914a service nova] Enqueued Resource ID: b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 with Priority: HIGHEST for action port [ 1181.945935] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_rules [ 1181.946363] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1181.946500] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 with Priority: HIGHEST for action port [ 1181.946924] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.947184] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.947284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.947548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.947677] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.950179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.950179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.950179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.950354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.951308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.951308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.952164] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.002914] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.450069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.450387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.454676] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 with status ACTIVE [ 1182.454947] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.455108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.455173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.455392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.455723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.455723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.455856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.455856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.455958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.456026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.456242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.456357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.456357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.456494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.456565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.456700] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6 is going to be updated. [ 1182.479480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.479690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.479690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.479881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.480056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.480173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b17c356d-ca8b-4f3b-af3d-c4bc0327f9d6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.505708] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.011019] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.011019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.011019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.011019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.011019] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.011019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be updated. [ 1183.041331] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.041331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.041331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.041331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.041331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.049445] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: IN_PROGRESS for 2s [ 1183.915251] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1183.915613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.915664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.915841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.916046] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.916167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.916233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.916387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.916468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.916565] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.418758] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.921560] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.062021] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 1185.062337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.062914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.063222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.063469] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.063598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.063666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.063932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.064058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.064146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.064277] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.426155] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.426155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.426155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.426155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.426155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.426155] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1185.454073] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.454235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.454362] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.454486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.454677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.468366] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1185.567130] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.610035] env[65660]: INFO networking_nsxv3.common.synchronization [req-24499365-1f75-446e-8eb7-9b1313a8cf1f req-cdcc2cde-c7a1-4307-9400-754730ed6f85 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_members [ 1185.610672] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGHEST for action security_group_members [ 1185.610998] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.613847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.613966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.614255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.614494] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.614630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.614724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.614898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.614992] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.615115] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.070223] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 225b293b-1569-42d6-87b8-ea54b1fed92d: rpc.has_security_group_logging(os_id): False [ 1186.094028] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.094268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.094268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.094503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.116499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.117059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.117234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.117351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.117779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.117779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.117909] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be updated. [ 1186.119701] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.119890] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.119957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.120243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.120411] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.120631] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.120771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.120864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.121098] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.121241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.121375] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c is going to be updated. [ 1186.190944] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.191115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.191182] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.191508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.191672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.205963] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c in Status: IN_PROGRESS for 2s [ 1186.260017] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.260301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.260301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.260546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.260698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.278317] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: IN_PROGRESS for 2s [ 1187.478397] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1187.478741] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.478776] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.478991] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.479206] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.479354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.479426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.479538] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.479620] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.479705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.479799] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.985032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.985032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.985032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.985032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.985032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.985694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.985694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.985694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.985694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.985694] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.216049] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c in Status: SUCCESS [ 1188.216266] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c deletion is rescheduled due to dependency. [ 1188.216551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.291069] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 1188.291364] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.488010] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acb2cb2-9e67-4059-8899-02421dd18f5c: rpc.has_security_group_logging(os_id): False [ 1188.507021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.508656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.508656] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.508656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.509320] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.509320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.509320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.509320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.509320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.509320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1188.610931] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.610931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.610931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.611167] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.611379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.638225] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1190.611431] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.611886] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1190.659709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1190.660012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.384994] env[65660]: INFO networking_nsxv3.common.synchronization [req-f7904045-d7e3-4da8-bc7c-2d72c5e753bd req-a2a126c0-5164-46b8-8c8a-571a8cc658b7 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_members [ 1191.385596] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGHEST for action security_group_members [ 1191.385929] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.386224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.386224] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.386351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.386903] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.386903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.386903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.387279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.387279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.387279] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.769505] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c8930830-cbf2-4acd-bbad-db25d5d19f44 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_rules [ 1191.770026] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_rules [ 1191.771030] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.771030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.771030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.771030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.771030] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.889124] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.889297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.889409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.889578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.889675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.889903] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.890031] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.890097] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.890272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.890786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.890786] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 is going to be updated. [ 1191.907626] env[65660]: INFO networking_nsxv3.common.synchronization [req-d599e9ed-95c5-4d70-8899-166f384da298 req-56fd4c6e-0b4b-4652-ab07-6b4bdbbc596f tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1191.908257] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1191.908574] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.908694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.908752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.908961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.909204] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.909315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.909368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.909509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.909623] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.909688] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.920561] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ec2a2770-dd3d-4313-80cd-4946c7ca3764 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_rules [ 1191.920788] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.920788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.920882] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.921061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.921195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.922854] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_rules [ 1191.923179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.923368] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.932134] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51e4307b-44db-4d05-8640-bb1b3523e887 in Status: IN_PROGRESS for 2s [ 1192.295699] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.295699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.295699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.295699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.295699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.295699] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 already deleted. [ 1192.295699] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.296261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.296261] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.296261] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.412077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.412260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.412380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.412594] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.412696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.412889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.413089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.413089] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.413284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.413284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.413438] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1192.445616] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.446140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.446140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.446140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.446319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.456546] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1192.821053] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.821447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.821447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.821516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.821664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.821766] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 already deleted. [ 1192.821879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.943430] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51e4307b-44db-4d05-8640-bb1b3523e887 in Status: SUCCESS [ 1193.943784] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 deletion is rescheduled due to dependency. [ 1193.943875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.466911] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1194.467150] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 deletion is rescheduled due to dependency. [ 1194.467286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.608547] env[65660]: INFO networking_nsxv3.common.synchronization [req-4aaa6d08-daa8-4d90-b9ae-72a2b2df90ae req-f6743456-e16f-4cee-9494-370629ed11f5 tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1194.609267] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1194.609579] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.609703] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.609768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.609970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.610138] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.610236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.610299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.610444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.610537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.610661] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.113056] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.614897] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.117778] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.117778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.117778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.118281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.118342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.118458] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1196.152763] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.152763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.152763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.153305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.153305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.164155] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1196.362099] env[65660]: INFO networking_nsxv3.common.synchronization [None req-13129b03-cd34-4eb9-8860-a109910a66d7 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_rules [ 1196.362639] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_rules [ 1196.362950] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.363091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.363158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.363432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.363519] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.434031] env[65660]: INFO networking_nsxv3.common.synchronization [None req-9eb0f6fc-2f48-445c-9ea8-0f57d5ed406f tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_rules [ 1196.434741] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_rules [ 1196.434741] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.434990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.988651] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.988651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.988848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.988946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.989052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.989153] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 already deleted. [ 1196.989232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.989385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.989546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.989628] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.513269] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.513668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.513668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.513743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.513777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.513877] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 already deleted. [ 1197.513976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.040576] env[65660]: INFO networking_nsxv3.common.synchronization [req-188a9a09-34cd-4a46-b579-df1d081f8bdb req-c54dd4a0-93be-46ef-887c-145c188bdd3c tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_members [ 1198.040730] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_members [ 1198.041057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.041178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.041241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.041711] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.041711] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.041836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.041836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.041955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.042016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.042129] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.174221] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1198.174449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.382317] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.382500] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.382628] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.382897] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.383166] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.383321] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.383437] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.383647] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.383789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.383994] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.384123] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.384233] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.384340] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.384448] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.384553] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.384681] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.404437] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.404599] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.404766] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.404969] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-507" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.405289] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.405460] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.405580] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.405893] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.406296] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a433fb9-f9fb-4222-a046-7d0ec95cc9c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.544436] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.544892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.545128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.545611] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.545822] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.546245] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.546434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.546564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.546875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.547035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.547222] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 already deleted. [ 1198.547403] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.909022] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.909307] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.909478] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.910789] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.910967] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.911183] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port 6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 not found, creating... [ 1198.911495] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.911667] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.911786] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.912039] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.912186] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.912483] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.912638] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.912757] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.912970] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.913124] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.913261] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: 6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 is going to be created. [ 1198.935450] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.935696] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.935824] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.936291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.936558] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.936930] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.625473] env[65660]: INFO networking_nsxv3.common.synchronization [req-188a9a09-34cd-4a46-b579-df1d081f8bdb req-edd8f933-524a-4344-bd65-973357618f37 service nova] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_rules [ 1199.625729] env[65660]: INFO networking_nsxv3.common.synchronization [req-188a9a09-34cd-4a46-b579-df1d081f8bdb req-edd8f933-524a-4344-bd65-973357618f37 service nova] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_members [ 1199.625845] env[65660]: INFO networking_nsxv3.common.synchronization [req-188a9a09-34cd-4a46-b579-df1d081f8bdb req-edd8f933-524a-4344-bd65-973357618f37 service nova] Enqueued Resource ID: 6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 with Priority: HIGHEST for action port [ 1199.626345] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_rules [ 1199.626477] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_members [ 1199.626571] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 with Priority: HIGHEST for action port [ 1199.626873] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.626994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.627108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.627270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.627348] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.628228] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.628321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.628459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.629035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.629035] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.629035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.629035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.629035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.629285] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.629285] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.630254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.630371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.631039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.631039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.631039] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a433fb9-f9fb-4222-a046-7d0ec95cc9c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.132229] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.133807] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.133807] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.134049] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 with status ACTIVE [ 1200.134138] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.134243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.134307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.134737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.134737] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.134874] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.134874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.135142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.135142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.135393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.135393] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.135521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.135521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.135614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.135679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.135872] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a433fb9-f9fb-4222-a046-7d0ec95cc9c9 is going to be updated. [ 1200.158690] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.158690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.158690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.158690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.158690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.158690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a433fb9-f9fb-4222-a046-7d0ec95cc9c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.637545] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.140888] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.141112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.141217] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.141389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.141484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.141587] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 is going to be created. [ 1201.168244] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.168495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.168495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.168714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.168914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.179662] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 in Status: UNINITIALIZED for 2s [ 1202.118023] env[65660]: INFO networking_nsxv3.common.synchronization [req-3b01a686-ebfb-4dc0-a018-f505cbd2c257 req-47f552ed-e900-488d-8db3-b56dbeea77c3 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1202.118770] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1202.119230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.119390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.119517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.119719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.119927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.120071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.120158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.120355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.120465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.120592] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.383783] env[65660]: INFO networking_nsxv3.common.synchronization [req-3fb61859-4813-453d-b16b-6f5e2494a67d req-653e43e4-da52-4062-be0b-9fff30e158e2 tempest-ServersTestJSON-1905621066 tempest-ServersTestJSON-1905621066-project-member] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1202.384786] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGHEST for action security_group_members [ 1202.385071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.385071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.385172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.385417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.385603] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.385719] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.385783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.385961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.386062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.386171] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.492521] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.492917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.492917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.493149] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.493413] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.493639] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.493836] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.494153] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.494314] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.494577] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1202.494706] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.494816] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.494936] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.495132] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1202.495307] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.495510] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.519226] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.519377] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1202.519487] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.519668] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.520101] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.520374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.520547] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.520904] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.521066] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc02dd0a-79e8-4156-ba4a-b00d6e6a0722',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.622697] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.622865] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.622926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.623657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.623657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.623657] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.623821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.623821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.623936] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.624018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.624473] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1202.652551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.652717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.652805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.653034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.653204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.664276] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1202.890740] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.890934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.890979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.891200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.891292] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.891493] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.891596] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.891658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.892077] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.892185] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.892233] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be updated. [ 1202.918796] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.918944] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.919033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.919251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.919387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.928905] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: IN_PROGRESS for 2s [ 1203.024258] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.024494] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.024622] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.024970] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.025140] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.025302] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 not found, creating... [ 1203.025561] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.025720] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.025836] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.026089] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.026246] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.026528] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.026683] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.026800] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.027081] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.027218] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.027357] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 is going to be created. [ 1203.049642] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.049838] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.050386] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.050386] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.050507] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.050746] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.191098] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 in Status: SUCCESS [ 1203.191479] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.191545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.191716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.191939] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.192094] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.192160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.192329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.192414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.192499] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.192592] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.694930] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.773323] env[65660]: INFO networking_nsxv3.common.synchronization [req-3b01a686-ebfb-4dc0-a018-f505cbd2c257 req-66b9e269-bef4-497c-bdee-5a5f7be9aa8b service nova] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 1203.773548] env[65660]: INFO networking_nsxv3.common.synchronization [req-3b01a686-ebfb-4dc0-a018-f505cbd2c257 req-66b9e269-bef4-497c-bdee-5a5f7be9aa8b service nova] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1203.773737] env[65660]: INFO networking_nsxv3.common.synchronization [req-3b01a686-ebfb-4dc0-a018-f505cbd2c257 req-66b9e269-bef4-497c-bdee-5a5f7be9aa8b service nova] Enqueued Resource ID: bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 with Priority: HIGHEST for action port [ 1203.774260] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 1203.774349] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1203.774437] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 with Priority: HIGHEST for action port [ 1203.774701] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.774817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.774974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.775232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.775322] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.776774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.777060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.777389] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.779504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.779504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.779504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.779504] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc02dd0a-79e8-4156-ba4a-b00d6e6a0722',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.197926] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dd3df8d-5b7a-444b-ab40-91a8424a0705: rpc.has_security_group_logging(os_id): False [ 1204.218083] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.218204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.218204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.218430] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.218521] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.218774] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.218885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.218989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.219148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.219232] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.219313] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 is going to be created. [ 1204.277457] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.277658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.280132] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 with status ACTIVE [ 1204.280394] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.280567] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.280658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.280901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.281012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.281213] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.281360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.281435] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.281608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.281689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.281883] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.282035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.282101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.282293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.282367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.282459] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc02dd0a-79e8-4156-ba4a-b00d6e6a0722 is going to be updated. [ 1204.292977] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.293197] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.293243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.293638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.293638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.306634] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 in Status: IN_PROGRESS for 2s [ 1204.307768] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.307859] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.307942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.308235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.308371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.308528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc02dd0a-79e8-4156-ba4a-b00d6e6a0722" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.507714] env[65660]: INFO networking_nsxv3.common.synchronization [req-244351e8-f001-48ec-83cf-227933591059 req-223673fb-8de6-411a-ad5f-9b78ec286db7 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_members [ 1204.508446] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_members [ 1204.508757] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.509139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.509315] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.509597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.509792] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.509918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.510015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.510211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.510322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.510443] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.675902] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1204.675902] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 deletion is rescheduled due to dependency. [ 1204.676142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.676877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.676877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.676877] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.676877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.676877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.677294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.677294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.677380] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.830930] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-220 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.831439] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.831611] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.831889] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.832178] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.832344] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.832462] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.832673] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.832825] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.833023] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.833138] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.833252] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.833350] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.833495] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.833589] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.833725] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.851361] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.851361] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1204.851510] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.851549] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-220" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.851861] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.852047] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.852172] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.852504] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.852644] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.938702] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c in Status: SUCCESS [ 1204.938882] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c deletion is rescheduled due to dependency. [ 1204.938996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.012996] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.013179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.013267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.013468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.013556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.013753] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.013851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.013910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.014070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.014183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.014216] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 already deleted. [ 1205.014293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.179899] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.356427] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.356844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.356844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.357112] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.357272] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.357408] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 not found, creating... [ 1205.357679] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.357835] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.357943] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.358176] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.358310] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.358585] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.358743] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.358838] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.359044] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.359183] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.359318] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 is going to be created. [ 1205.381406] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.381632] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.381758] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.382052] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.382282] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.382512] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.683658] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.090653] env[65660]: INFO networking_nsxv3.common.synchronization [req-244351e8-f001-48ec-83cf-227933591059 req-a2d75508-9bc7-4fcc-b1b5-704f2de5fa7b service nova] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_rules [ 1206.090653] env[65660]: INFO networking_nsxv3.common.synchronization [req-244351e8-f001-48ec-83cf-227933591059 req-a2d75508-9bc7-4fcc-b1b5-704f2de5fa7b service nova] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_members [ 1206.090653] env[65660]: INFO networking_nsxv3.common.synchronization [req-244351e8-f001-48ec-83cf-227933591059 req-a2d75508-9bc7-4fcc-b1b5-704f2de5fa7b service nova] Enqueued Resource ID: 4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 with Priority: HIGHEST for action port [ 1206.090653] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_rules [ 1206.090653] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_members [ 1206.090653] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 with Priority: HIGHEST for action port [ 1206.091146] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.091323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.091490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.091763] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.091895] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.093728] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.093929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.094053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.094329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.094606] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.094773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.095433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.095877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.095976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.096119] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.097512] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.097681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.097780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.098554] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.098622] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.188392] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.188392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.188392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.188392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.188392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.188392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1206.222817] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.223029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.223100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.223367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.223580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.232948] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1206.322062] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 in Status: SUCCESS [ 1206.322286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.594018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.594497] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.600769] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 with status ACTIVE [ 1206.601059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.601227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.601284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.601566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.601617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.601807] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.601939] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.602009] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.602144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.602227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.602674] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.602855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.602969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.603246] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.603381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.603524] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594 is going to be updated. [ 1206.605331] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.629665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.629871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.629986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.630326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.630545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.630802] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f8c1b53-0a3e-4a7e-b00e-0a48c66ba594" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.108548] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.611713] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.612021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.612021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.612316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.612437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.612648] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 is going to be created. [ 1207.636077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.636241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.636303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.636600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.636667] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.648719] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 in Status: UNINITIALIZED for 2s [ 1208.244453] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1208.244725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.244957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.245159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.245357] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.245607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.245687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.245811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.245887] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.245970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.246076] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.748683] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.251252] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2604d13b-747f-46b6-934c-17fb07504709: rpc.has_security_group_logging(os_id): False [ 1209.272791] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.272947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.273039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.273255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.273347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.273594] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.273761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.273761] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.273901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.274028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.274114] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1209.337751] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.337986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.337986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.338254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.338449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.351386] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1209.660678] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 in Status: SUCCESS [ 1209.660902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.661083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.661330] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.661527] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.661663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.661733] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.661897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.661978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.662078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.662169] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.164703] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.421967] env[65660]: INFO networking_nsxv3.common.synchronization [req-900223e7-edd9-469a-a056-94c28990938b req-ed022353-68a6-4bf5-8f27-33627ab45f33 tempest-DeleteServersTestJSON-866316424 tempest-DeleteServersTestJSON-866316424-project-member] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1210.423238] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGHEST for action security_group_members [ 1210.423238] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.423238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.423465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.423513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.423673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.423784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.423849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.424021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.424129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.424227] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.667067] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 901fa1df-3975-439c-91f8-bc49d2f46c89: rpc.has_security_group_logging(os_id): False [ 1210.687565] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.688183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.688183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.688431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.688431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.688692] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.688862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.689028] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.690067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.690067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.690067] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 is going to be created. [ 1210.753188] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.753358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.753443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.753727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.754173] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.765974] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 in Status: IN_PROGRESS for 2s [ 1210.926408] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.926576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.926615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.926839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.926930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.927297] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.927398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.927443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.927621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.927704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.927796] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be updated. [ 1210.959425] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.959629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.959695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.960023] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.960204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.971656] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: IN_PROGRESS for 2s [ 1211.365073] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1211.365331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.780320] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 in Status: SUCCESS [ 1212.780726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.983268] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 in Status: SUCCESS [ 1212.983465] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 deletion is rescheduled due to dependency. [ 1212.983551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.423663] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.424072] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1220.424762] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.425044] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1221.777913] env[65660]: INFO networking_nsxv3.common.synchronization [None req-a84cb668-2bb0-48a3-ba5b-05e0391af203 None None] Enqueued Resource ID: 0d14689c-8c32-48df-b613-d4c8b8a842fe with Priority: HIGHEST for action port [ 1221.778478] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d14689c-8c32-48df-b613-d4c8b8a842fe with Priority: HIGHEST for action port [ 1221.778807] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d14689c-8c32-48df-b613-d4c8b8a842fe taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.778929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d14689c-8c32-48df-b613-d4c8b8a842fe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.778999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d14689c-8c32-48df-b613-d4c8b8a842fe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.779372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d14689c-8c32-48df-b613-d4c8b8a842fe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.779475] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d14689c-8c32-48df-b613-d4c8b8a842fe',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.281737] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d14689c-8c32-48df-b613-d4c8b8a842fe [ 1222.281986] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.282118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.282163] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.282456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.282568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.282652] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d14689c-8c32-48df-b613-d4c8b8a842fe already deleted. [ 1222.282704] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d14689c-8c32-48df-b613-d4c8b8a842fe" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.913667] env[65660]: INFO networking_nsxv3.common.synchronization [None req-a261ba44-286c-4b29-b927-edab2daadb0c None None] Enqueued Resource ID: 8111de39-4d73-44d6-879c-e12f3d7ba1c1 with Priority: HIGHEST for action port [ 1223.914275] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8111de39-4d73-44d6-879c-e12f3d7ba1c1 with Priority: HIGHEST for action port [ 1223.914592] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-8111de39-4d73-44d6-879c-e12f3d7ba1c1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.914826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8111de39-4d73-44d6-879c-e12f3d7ba1c1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.914917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8111de39-4d73-44d6-879c-e12f3d7ba1c1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.915241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8111de39-4d73-44d6-879c-e12f3d7ba1c1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.915329] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8111de39-4d73-44d6-879c-e12f3d7ba1c1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.417365] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8111de39-4d73-44d6-879c-e12f3d7ba1c1 [ 1224.417597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.417732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.417799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.418092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.418155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.418262] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8111de39-4d73-44d6-879c-e12f3d7ba1c1 already deleted. [ 1224.418355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8111de39-4d73-44d6-879c-e12f3d7ba1c1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.378965] env[65660]: INFO networking_nsxv3.common.synchronization [req-3c1d49e2-69ac-4a17-8bcf-ac2c6bb89352 req-8c343fa2-5273-468c-9368-c0d4c23a7844 tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1226.379431] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1226.379771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.379884] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.379951] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.380208] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.380415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.380526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.380615] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.380801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.381284] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.381392] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.883756] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.883997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.884082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.884300] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.884396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.884596] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.884690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.884752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.884899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.884972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.885088] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1226.912022] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.912250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.912250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.912429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.912575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.920762] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1228.053037] env[65660]: INFO networking_nsxv3.common.synchronization [req-0fbb7627-7b33-4ac6-8f51-ab2429e3ee47 req-a8b37bda-2ff7-4a63-b5d9-f245cd866fac tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1228.053778] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1228.054242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.054432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.054546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.054935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.055183] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.055389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.055465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.055647] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.055738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.055838] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.359321] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.359517] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-494" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.359640] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-494" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.359988] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-494" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.360263] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.360427] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.360574] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.360797] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.360943] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.361159] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.361295] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.361380] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.361488] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.361596] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.361701] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.361834] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.384843] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.384843] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1228.384983] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.385195] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-494" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.385499] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-04fd623b-e0d5-48c8-ace4-5abd456cad37 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.385669] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.385787] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.386259] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.386419] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fd623b-e0d5-48c8-ace4-5abd456cad37',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.558190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.558398] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.558460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.558661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.558752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.558951] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.559064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.559128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.559281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.559376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.559463] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 already deleted. [ 1228.559549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.889113] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.889365] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.889475] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.889791] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.889940] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.890117] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Segment Port 04fd623b-e0d5-48c8-ace4-5abd456cad37 not found, creating... [ 1228.890423] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.890595] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.890713] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.890928] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.891078] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.891352] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.891507] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.891622] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.891827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.891959] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.892115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 is going to be created. [ 1228.915163] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.915397] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.915500] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.915775] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.915997] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.916276] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.932063] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1228.932063] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 deletion is rescheduled due to dependency. [ 1228.932063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.621839] env[65660]: INFO networking_nsxv3.common.synchronization [req-0fbb7627-7b33-4ac6-8f51-ab2429e3ee47 req-49fee43b-24a9-4c0d-a0e8-62a74f997e92 service nova] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_rules [ 1229.622089] env[65660]: INFO networking_nsxv3.common.synchronization [req-0fbb7627-7b33-4ac6-8f51-ab2429e3ee47 req-49fee43b-24a9-4c0d-a0e8-62a74f997e92 service nova] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1229.622289] env[65660]: INFO networking_nsxv3.common.synchronization [req-0fbb7627-7b33-4ac6-8f51-ab2429e3ee47 req-49fee43b-24a9-4c0d-a0e8-62a74f997e92 service nova] Enqueued Resource ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 with Priority: HIGHEST for action port [ 1229.622888] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_rules [ 1229.624664] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1229.624842] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 with Priority: HIGHEST for action port [ 1229.625139] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.625222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.625314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.626081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.626081] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.626508] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.627140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.627140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.627140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.627140] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.627140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.627140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.628283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.628283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.628283] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.629283] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-04fd623b-e0d5-48c8-ace4-5abd456cad37 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.629283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.629283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.629283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.629283] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fd623b-e0d5-48c8-ace4-5abd456cad37',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.131406] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.131954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.132117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.132568] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04fd623b-e0d5-48c8-ace4-5abd456cad37 with status ACTIVE [ 1230.132812] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.132977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.133074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.133551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.133551] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.133686] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.133767] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.133830] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.133986] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.134142] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.134327] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.134431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.134520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.134718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.134783] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.134854] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 is going to be updated. [ 1230.158364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.159024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.159024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.159024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.159240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.159401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.633615] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.136449] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.136686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.136793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.137067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.137308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.137533] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be created. [ 1231.166143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.166143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.166143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.166349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.166506] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.176291] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: UNINITIALIZED for 2s [ 1233.190071] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1233.190071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.190071] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.190543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.190624] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.190826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.190954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.191241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.191395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.191549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.191680] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.694431] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.694684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.694684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.694837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.695062] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.695257] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.695322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.695483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.695582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.695705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.695914] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.696072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.696129] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.696339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.696547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.696663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.696756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.696954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.697101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.697252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.697371] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.201103] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e86a55da-0547-4f65-b22f-0512b6cabfb8: rpc.has_security_group_logging(os_id): False [ 1234.219051] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.219283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.219345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.219578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.219683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.219981] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.220072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.220135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.220339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.220436] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.220651] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.220779] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.220851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.220997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.221125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.221305] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.221437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.221503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.221663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.221749] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.221835] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be created. [ 1234.280772] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.281062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.281062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.281233] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.281382] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.292111] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1234.626349] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1234.626511] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1234.717671] env[65660]: INFO networking_nsxv3.common.synchronization [req-78cf23c7-ad0c-4357-800e-d939610a6274 req-62de7887-546c-449c-9b22-8f4c8e621293 tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1234.718264] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1234.718602] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.718744] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.718825] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.719052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.719222] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.719331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.719423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.719614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.719718] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.719831] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.985713] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.985917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.986056] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.986336] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.986588] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.986742] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.986856] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.987103] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.987227] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.987457] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.987569] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.987676] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.987779] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.987885] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.987986] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.988130] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.008631] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.008814] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1235.008931] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.009128] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.009504] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-e0bf3688-7174-47b7-b550-62713303152c taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.009762] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.009886] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.010248] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.010399] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0bf3688-7174-47b7-b550-62713303152c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.223530] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.223975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.223975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.223975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.224130] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.224308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.224409] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.224486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.224650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.224729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.224832] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1235.266021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.266215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.266293] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.266540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.266693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.276878] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1235.513137] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.513329] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.513439] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.513724] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.513869] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.514030] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port e0bf3688-7174-47b7-b550-62713303152c not found, creating... [ 1235.514289] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.514447] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.514562] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.514773] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.514908] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.515211] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.515449] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.515564] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.515768] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.515913] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.516040] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: e0bf3688-7174-47b7-b550-62713303152c is going to be created. [ 1235.535774] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.536019] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.536108] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.536392] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.536612] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.536846] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.243047] env[65660]: INFO networking_nsxv3.common.synchronization [req-78cf23c7-ad0c-4357-800e-d939610a6274 req-592b9659-2cc6-4bf7-9ef3-11fc6594b294 service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 1236.243289] env[65660]: INFO networking_nsxv3.common.synchronization [req-78cf23c7-ad0c-4357-800e-d939610a6274 req-592b9659-2cc6-4bf7-9ef3-11fc6594b294 service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1236.243362] env[65660]: INFO networking_nsxv3.common.synchronization [req-78cf23c7-ad0c-4357-800e-d939610a6274 req-592b9659-2cc6-4bf7-9ef3-11fc6594b294 service nova] Enqueued Resource ID: e0bf3688-7174-47b7-b550-62713303152c with Priority: HIGHEST for action port [ 1236.243985] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 1236.244221] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1236.244314] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0bf3688-7174-47b7-b550-62713303152c with Priority: HIGHEST for action port [ 1236.244665] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.244856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.245032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.245375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.245561] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.247736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.247736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.247736] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0bf3688-7174-47b7-b550-62713303152c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.247736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.247736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.247736] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.247736] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0bf3688-7174-47b7-b550-62713303152c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.303711] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1236.303958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.749848] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.749848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.749848] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0bf3688-7174-47b7-b550-62713303152c with status ACTIVE [ 1236.749848] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.750195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.750195] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.750415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.750415] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.750485] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.750566] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.750624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.750867] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.750969] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.751126] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.751219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.751278] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.751420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.751491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.751573] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0bf3688-7174-47b7-b550-62713303152c is going to be updated. [ 1236.772314] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.772539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.772619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.772820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.772973] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.773156] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.289889] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1237.290204] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 deletion is rescheduled due to dependency. [ 1237.290483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.290770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.291275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.291556] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.291738] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.291868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.292133] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.292274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.292437] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.794916] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.296947] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.799409] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.799503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.799656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.799953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.800115] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.800282] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1238.834254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.834472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.834472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.834678] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.834912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.844393] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1240.857055] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1240.857055] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.857503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.857604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.857739] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.857841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.857906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.858105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.858213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.858302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.858396] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.245250] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.245395] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1241.360368] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.377403] env[65660]: INFO networking_nsxv3.common.synchronization [req-4a4c7f0e-96c6-45b7-b0f1-b45978fa42c6 req-5a70924e-4519-4fe0-b74d-43744945e9da tempest-ServersV294TestFqdnHostnames-1957478415 tempest-ServersV294TestFqdnHostnames-1957478415-project-member] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_members [ 1241.377897] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGHEST for action security_group_members [ 1241.378226] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.378417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.378417] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.378607] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.378744] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.378850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.378912] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.379081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.379179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.379290] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.862513] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f149ebe9-de13-482c-885e-b787b9881cd4: rpc.has_security_group_logging(os_id): False [ 1241.880146] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.880393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.880393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.880617] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.880696] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.880889] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.881059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.881059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.881218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.881267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.881356] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1241.882725] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.882838] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.882903] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.883065] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.883146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.883315] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.883419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.883484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.883595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.883670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.883751] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 is going to be updated. [ 1241.916914] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.916914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.916914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.916914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.916914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.927263] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: IN_PROGRESS for 2s [ 1241.951362] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.951559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.951675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.951856] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.952044] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.965572] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1243.937032] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 in Status: SUCCESS [ 1243.937329] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 deletion is rescheduled due to dependency. [ 1243.937329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.979852] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1243.980020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.372280] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.372590] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_members [ 1245.373017] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.373172] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_members [ 1245.373455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.373575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.373639] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.373842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.373989] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.374070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.374140] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.374319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.374442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.374587] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.375512] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f54d49-6795-46a1-8c98-d9572dc024ca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.375584] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.375633] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.375864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.376047] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.376152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.376230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.376418] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.376526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.376619] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.416554] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_rules [ 1245.416731] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_members [ 1245.416870] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_rules [ 1245.416998] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.417143] env[65660]: INFO networking_nsxv3.common.synchronization [req-fb2bb39a-5e44-48ff-b3a6-8cd03f244c8b req-c25132df-2219-488f-ade5-95fe9c2ae9db tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 with Priority: HIGHEST for action port [ 1245.417701] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_rules [ 1245.417833] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_rules [ 1245.417929] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 with Priority: HIGHEST for action port [ 1245.418031] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_members [ 1245.418125] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.418677] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f54d49-6795-46a1-8c98-d9572dc024ca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.418793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.418879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.419219] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.419308] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.420151] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.420271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.420351] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.420582] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.420636] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.421964] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-04fd623b-e0d5-48c8-ace4-5abd456cad37 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.421964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.421964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.421964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.421964] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fd623b-e0d5-48c8-ace4-5abd456cad37',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.422589] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f54d49-6795-46a1-8c98-d9572dc024ca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.423236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.423236] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.423236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.711588] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec351eca-a083-4921-8027-b07a942b045b req-b375a654-d8c5-40fe-bdfd-b23d8de72fa1 tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.711750] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec351eca-a083-4921-8027-b07a942b045b req-b375a654-d8c5-40fe-bdfd-b23d8de72fa1 tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_members [ 1245.712355] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.712708] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f54d49-6795-46a1-8c98-d9572dc024ca with Priority: HIGHEST for action security_group_members [ 1245.712856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.712961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.713247] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f54d49-6795-46a1-8c98-d9572dc024ca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.713328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.753182] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec351eca-a083-4921-8027-b07a942b045b req-b375a654-d8c5-40fe-bdfd-b23d8de72fa1 tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_rules [ 1245.753414] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec351eca-a083-4921-8027-b07a942b045b req-b375a654-d8c5-40fe-bdfd-b23d8de72fa1 tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.753592] env[65660]: INFO networking_nsxv3.common.synchronization [req-ec351eca-a083-4921-8027-b07a942b045b req-b375a654-d8c5-40fe-bdfd-b23d8de72fa1 tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 with Priority: HIGHEST for action port [ 1245.754143] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_rules [ 1245.754299] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1245.754402] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 with Priority: HIGHEST for action port [ 1245.754723] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.754839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.755487] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.755630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.755825] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-04fd623b-e0d5-48c8-ace4-5abd456cad37 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.755917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.880263] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.881397] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.924056] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f54d49-6795-46a1-8c98-d9572dc024ca taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.924056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.924892] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.925068] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.925289] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04fd623b-e0d5-48c8-ace4-5abd456cad37 with status ACTIVE [ 1245.925575] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.925677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.925772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.925964] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.926085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.926235] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.926323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.926376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.926535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.926610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.926817] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.926917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.926971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.927125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.927191] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.927284] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 is going to be updated. [ 1245.949351] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.950014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.950014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.950014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.950014] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.950301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.950349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.950520] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.950637] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fd623b-e0d5-48c8-ace4-5abd456cad37',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.383979] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.385543] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.453180] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04fd623b-e0d5-48c8-ace4-5abd456cad37 with status ACTIVE [ 1246.453439] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.453583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.453660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.453984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.454096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.454352] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.454508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.454598] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.454790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.454898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.455129] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.455259] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.455397] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.455628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.455753] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.455848] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04fd623b-e0d5-48c8-ace4-5abd456cad37 is going to be updated. [ 1246.483949] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.484160] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.484553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.484553] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.484690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.484876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04fd623b-e0d5-48c8-ace4-5abd456cad37" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.887886] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.888059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.888132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.888367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.889107] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.889107] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be updated. [ 1246.890352] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.890352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.890352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.890352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.890560] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.890560] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca is going to be created. [ 1246.917190] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.917515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.917635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.918024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.918024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.933623] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f54d49-6795-46a1-8c98-d9572dc024ca in Status: UNINITIALIZED for 2s [ 1246.937113] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.937306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.937355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.937635] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.937778] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.947299] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1248.943925] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f54d49-6795-46a1-8c98-d9572dc024ca in Status: SUCCESS [ 1248.944313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.944394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.944683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.944917] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.945057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.945151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.945341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.945440] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.945549] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.955379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1248.955588] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.955758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.955984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.956179] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.956291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.956357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.956509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.956589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.956684] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.449018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.449018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.449018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.449018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.449018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.449018] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.449358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.449358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.449358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.449456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.449488] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca is going to be deleted. [ 1249.459280] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.485455] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.485619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.485690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.485899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.485990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.486103] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.486339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.486548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.486954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.487081] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.487147] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.487301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.487396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.487558] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.964198] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.990310] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.990837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.990837] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.991118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.991306] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.991640] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.991803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.991877] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.992061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.992158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.992274] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca already deleted. [ 1249.992360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.992545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.992680] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.992919] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.992994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.993057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.993299] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.993424] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.993553] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.471108] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.471108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.471108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.471108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.471108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.471108] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be updated. [ 1250.499866] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.502049] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.502049] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca already deleted. [ 1250.502049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.502049] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.505576] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.508051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.508108] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.508638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.508638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.520616] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1250.662228] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1250.662228] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:3 started [ 1250.755250] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.755250] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1251.010939] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1f54d49-6795-46a1-8c98-d9572dc024ca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.255748] env[65660]: INFO networking_nsxv3.common.synchronization [req-04a0a559-8757-4959-8cc1-96974e955bbe req-c73952f1-304d-48d1-b3d2-6bf4adf877fd tempest-ServerRescueTestJSONUnderV235-972642495 tempest-ServerRescueTestJSONUnderV235-972642495-project-member] Enqueued Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1251.256318] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 with Priority: HIGHEST for action security_group_members [ 1251.256620] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86a55da-0547-4f65-b22f-0512b6cabfb8 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.256725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.513862] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1f54d49-6795-46a1-8c98-d9572dc024ca: rpc.has_security_group_logging(os_id): False [ 1251.517605] env[65660]: INFO networking_nsxv3.common.synchronization [None req-c5a6a1bc-dde9-490b-9661-b7a2233a473a None None] Enqueued Resource ID: ec6e035c-fced-4d29-87a5-d932fe98c991 with Priority: HIGHEST for action port [ 1251.519026] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6e035c-fced-4d29-87a5-d932fe98c991 with Priority: HIGHEST for action port [ 1251.519026] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec6e035c-fced-4d29-87a5-d932fe98c991 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.519026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec6e035c-fced-4d29-87a5-d932fe98c991" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.519026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec6e035c-fced-4d29-87a5-d932fe98c991" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.519026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec6e035c-fced-4d29-87a5-d932fe98c991" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.519288] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6e035c-fced-4d29-87a5-d932fe98c991',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.533330] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.533472] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.533539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.533773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.533828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.534033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.534118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.534175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.534322] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.534396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.534482] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca is going to be created. [ 1251.553086] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e1f54d49-6795-46a1-8c98-d9572dc024ca], does not exist path=[/infra/domains/default/groups/e1f54d49-6795-46a1-8c98-d9572dc024ca]."\n}' [ 1251.553297] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1f54d49-6795-46a1-8c98-d9572dc024ca [ 1251.553406] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1251.599962] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.599962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.599962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.599962] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.600996] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.601229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.601396] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.601452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.601624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.601735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.601917] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.602056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.602131] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.602281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.602355] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.602455] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f54d49-6795-46a1-8c98-d9572dc024ca is going to be created. [ 1251.618323] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e1f54d49-6795-46a1-8c98-d9572dc024ca], does not exist path=[/infra/domains/default/groups/e1f54d49-6795-46a1-8c98-d9572dc024ca]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1f54d49-6795-46a1-8c98-d9572dc024ca [ 1251.618323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f54d49-6795-46a1-8c98-d9572dc024ca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.618517] env[65660]: Traceback (most recent call last): [ 1251.618517] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1251.618517] env[65660]: return func(*args, **kwargs) [ 1251.618517] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1251.618517] env[65660]: res.raise_for_status() [ 1251.618517] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1251.618517] env[65660]: raise HTTPError(http_error_msg, response=self) [ 1251.618517] env[65660]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1f54d49-6795-46a1-8c98-d9572dc024ca [ 1251.618517] env[65660]: During handling of the above exception, another exception occurred: [ 1251.618517] env[65660]: Traceback (most recent call last): [ 1251.618887] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1251.618887] env[65660]: listener.cb(fileno) [ 1251.618887] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1251.618887] env[65660]: result = function(*args, **kwargs) [ 1251.618887] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1251.618887] env[65660]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1251.618887] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1251.618887] env[65660]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1251.618887] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1251.618887] env[65660]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1251.618887] env[65660]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1251.618887] env[65660]: res.raise_for_status() [ 1251.618887] env[65660]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1251.618887] env[65660]: raise HTTPError(http_error_msg, response=self) [ 1251.618887] env[65660]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1f54d49-6795-46a1-8c98-d9572dc024ca [ 1251.618887] env[65660]: Removing descriptor: 69 [ 1251.840264] env[65660]: INFO networking_nsxv3.common.synchronization [None req-736314cd-5866-4686-94c3-b71bb5d4ad9b tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1251.840702] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1251.841016] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.841144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.841210] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.841461] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.841541] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.923577] env[65660]: INFO networking_nsxv3.common.synchronization [None req-ff0b4270-1e55-4571-a0ba-7080a2576f32 tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1251.924162] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1251.924591] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.924706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.023147] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec6e035c-fced-4d29-87a5-d932fe98c991 [ 1252.023551] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.023679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.023766] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.024151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.024274] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.024399] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec6e035c-fced-4d29-87a5-d932fe98c991 already deleted. [ 1252.024491] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec6e035c-fced-4d29-87a5-d932fe98c991" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.362646] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.362910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.362910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.363158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.363158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.363244] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 already deleted. [ 1252.363379] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.363486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.363641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.363742] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.531286] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1252.531286] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.531425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.531673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.531870] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.531982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.532056] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.532213] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.532288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.532440] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.887128] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.887294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.887354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.887603] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.887690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.887795] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 already deleted. [ 1252.887871] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.901741] env[65660]: INFO networking_nsxv3.common.synchronization [req-e70eb112-3d0e-48ac-9e67-2696a3fb1c1a req-09a88cfc-34ab-4869-829e-2eefb6416f43 tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1252.902299] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1252.902608] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.902729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.902791] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.902982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.903316] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.903486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.903486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.903629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.903712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.903802] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.038038] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.038038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.038038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.038038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.058158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.058463] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.058651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.058651] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.058820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.058901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.058991] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be updated. [ 1253.086637] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.086785] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.086851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.087074] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.087222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.097183] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1253.406675] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.848817] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d8e3e1e8-20d9-4289-bda1-7134f6c4d966 None None] Enqueued Resource ID: 788e062e-a87a-4d7f-8a47-804afaf6a57a with Priority: HIGHEST for action port [ 1253.849074] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788e062e-a87a-4d7f-8a47-804afaf6a57a with Priority: HIGHEST for action port [ 1253.849382] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-788e062e-a87a-4d7f-8a47-804afaf6a57a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.849502] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788e062e-a87a-4d7f-8a47-804afaf6a57a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.849570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788e062e-a87a-4d7f-8a47-804afaf6a57a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.849828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788e062e-a87a-4d7f-8a47-804afaf6a57a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.849908] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788e062e-a87a-4d7f-8a47-804afaf6a57a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.909570] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.353061] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 788e062e-a87a-4d7f-8a47-804afaf6a57a [ 1254.353061] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.353061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.353061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.353061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.353061] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.353625] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:788e062e-a87a-4d7f-8a47-804afaf6a57a already deleted. [ 1254.353625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788e062e-a87a-4d7f-8a47-804afaf6a57a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.412671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.412893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.413041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.413372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.413535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.413709] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be updated. [ 1254.450264] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.450264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.450264] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.450529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.450529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.462740] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: IN_PROGRESS for 2s [ 1255.108806] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1255.108962] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 deletion is rescheduled due to dependency. [ 1255.109030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.109211] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.109801] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.109801] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.109968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.109968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.110150] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.110234] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.110348] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.613231] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.613546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.613546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.613706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.613805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.614011] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.614112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.614174] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.614326] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.614400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.614485] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be updated. [ 1255.639257] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.639449] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.639495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.639784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.639965] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.648986] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1256.474855] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 1256.475062] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.658689] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1257.659027] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 deletion is rescheduled due to dependency. [ 1257.659027] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.659162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.659381] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.659571] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.659690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.659752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.659906] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.659984] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.660079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.660177] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.661482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.661482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.661482] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.661729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.661729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.661729] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.661828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.661828] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.164771] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.165364] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.166332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.166332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.166332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.166332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.166332] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.166581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.166581] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.166643] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.166748] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.166874] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be updated. [ 1258.197187] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.197422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.197422] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.197637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.197793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.207422] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1258.368895] env[65660]: INFO networking_nsxv3.common.synchronization [req-b04a05a2-65c3-41ff-af83-b40ddfe6486d req-32a42f8e-a4b8-4c24-a978-3ee609ff81c8 tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1258.369645] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1258.369645] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.369645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.369645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.369875] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.370172] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.370356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.370356] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.370510] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.370589] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.370841] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.668955] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e86a55da-0547-4f65-b22f-0512b6cabfb8: rpc.has_security_group_logging(os_id): False [ 1258.730716] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.730984] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.731174] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.731543] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.731846] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.732064] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.732182] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.732407] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.732551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.732768] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1258.732881] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1258.732989] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1258.733110] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1258.733266] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1258.733312] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1258.733447] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1258.761510] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.761730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.761730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.761947] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.762052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.762259] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.762360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.762434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.762580] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.762657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.762747] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be updated. [ 1258.792835] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1258.793053] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.060 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1258.793161] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1258.793349] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.793665] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-eaf5b027-661f-4ea5-bd21-a82c7ef11192 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.793841] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.793961] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.794388] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.794540] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf5b027-661f-4ea5-bd21-a82c7ef11192',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.847970] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.848205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.848205] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.848523] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.848688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.870627] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: IN_PROGRESS for 2s [ 1258.873143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.873309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.873404] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.873705] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.873828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.874059] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.874192] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.874275] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.874458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.874555] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.874733] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 already deleted. [ 1258.874840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.297177] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.297572] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.297730] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.298101] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.298346] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.298564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port eaf5b027-661f-4ea5-bd21-a82c7ef11192 not found, creating... [ 1259.298865] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.299120] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.299335] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.299703] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.299935] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.300313] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.300533] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.300741] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.301082] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.301274] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.301463] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 is going to be created. [ 1259.335156] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.335738] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.335929] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.336296] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.336523] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.336942] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.974610] env[65660]: INFO networking_nsxv3.common.synchronization [req-b04a05a2-65c3-41ff-af83-b40ddfe6486d req-24574064-2e52-4ad0-b75b-6fc07d1b94a0 service nova] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1259.974885] env[65660]: INFO networking_nsxv3.common.synchronization [req-b04a05a2-65c3-41ff-af83-b40ddfe6486d req-24574064-2e52-4ad0-b75b-6fc07d1b94a0 service nova] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1259.974989] env[65660]: INFO networking_nsxv3.common.synchronization [req-b04a05a2-65c3-41ff-af83-b40ddfe6486d req-24574064-2e52-4ad0-b75b-6fc07d1b94a0 service nova] Enqueued Resource ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 with Priority: HIGHEST for action port [ 1259.975482] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1259.975622] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1259.975719] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 with Priority: HIGHEST for action port [ 1259.975983] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.977076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.977076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.977076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.977255] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.978254] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.978254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.978254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.978597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.978597] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.979457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.979457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.979457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.979457] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.979457] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.979814] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaf5b027-661f-4ea5-bd21-a82c7ef11192 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.980021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.980116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.980307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.980531] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf5b027-661f-4ea5-bd21-a82c7ef11192',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.217461] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1260.217705] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 deletion is rescheduled due to dependency. [ 1260.217832] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.482531] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.482672] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.482875] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.483780] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaf5b027-661f-4ea5-bd21-a82c7ef11192 with status ACTIVE [ 1260.483983] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.484138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.484209] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.484414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.484500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.485049] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.485049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.485049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.485049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.485049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.485282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.485282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.485378] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.485483] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.485548] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.485631] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 is going to be updated. [ 1260.509115] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.509388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.509388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.509571] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.509668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.509835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.884378] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 in Status: SUCCESS [ 1260.884650] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.884828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.885096] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.885188] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e86a55da-0547-4f65-b22f-0512b6cabfb8',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.987319] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.404765] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.404942] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.404982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.405332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.420806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.420950] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e86a55da-0547-4f65-b22f-0512b6cabfb8 is going to be deleted. [ 1261.458505] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.458674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.458713] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.458929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.459032] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.459135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e86a55da-0547-4f65-b22f-0512b6cabfb8" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.489781] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.489988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.490049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.490249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.490332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.490427] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 is going to be created. [ 1261.513420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.513420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.513420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.513420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.513684] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.523409] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: UNINITIALIZED for 2s [ 1263.538840] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: SUCCESS [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.538840] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.538840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.538840] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.720803] env[65660]: INFO networking_nsxv3.common.synchronization [req-c2414e89-e51f-4250-99cf-284316c59bc2 req-9e371e1d-f81d-44e3-add2-665838f84de9 tempest-AttachVolumeNegativeTest-1969867171 tempest-AttachVolumeNegativeTest-1969867171-project-member] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_members [ 1263.721662] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGHEST for action security_group_members [ 1263.721662] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.721662] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.721821] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.721979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.722771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.722771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.722771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.722771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.722771] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.722771] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.042156] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.229563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.230283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.231325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.232347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.257619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.257805] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.257955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.257955] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.258212] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.258301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.258353] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 is going to be updated. [ 1264.286777] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.287015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.287015] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.287223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.287366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.299590] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 in Status: IN_PROGRESS for 2s [ 1264.545296] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5: rpc.has_security_group_logging(os_id): False [ 1264.565927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.565927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.565927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.565927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.565927] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.565927] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.566253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.566253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.566253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.566332] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.567426] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 is going to be created. [ 1264.625107] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.626024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.626024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.626024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.626024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.637209] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: IN_PROGRESS for 2s [ 1265.597099] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.597541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.597541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.597541] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.597804] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.100312] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.310874] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 in Status: SUCCESS [ 1266.311117] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 deletion is rescheduled due to dependency. [ 1266.311245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.604326] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.653529] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: SUCCESS [ 1266.653880] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.107103] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1267.107245] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1267.986878] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.987341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.987341] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.987543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.008401] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1268.009193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.010065] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1268.048097] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.048294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.048294] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.048508] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.065649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.066746] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1268.066869] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.066944] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1268.111695] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.111876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.111952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.112637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.113621] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.113939] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1268.206053] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.206053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.206053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.206053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.206053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.206053] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1268.304430] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.304616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.304668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.304848] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.305249] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.305673] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1268.305747] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'eaef59ac-b94f-47d8-8852-ec864d2e9eeb', '95dbc5ce-23c5-4cf9-a9a6-b4703d803c63', 'aaaf560a-6fd3-465d-97f1-23540c20f1b1', '332826ee-e169-4398-8162-f86ad56e690d', '4e872372-e4f2-43b5-922d-ee045d8baf5b', 'b604088e-8278-4c35-a94f-fc57fbebf7a4', '2604d13b-747f-46b6-934c-17fb07504709', '4cecee2b-3b4b-4faf-a5cb-ce4521ea583f', 'cb098160-f09b-4c92-93a4-fb3bb43d9826', 'cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a', 'da44bcac-8dcd-43ae-b931-eee44940a29b', '0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5', '1dbcba73-4b06-4756-bd56-81b58777d093', '4a06f441-5f17-4ab5-b491-331edf1151db', '3402fe38-bb82-4e23-ab22-23f54a22de87', '0a8aaa9b-7467-48c3-bfb1-e630aeec084c', '51e4307b-44db-4d05-8640-bb1b3523e887', '1dd3df8d-5b7a-444b-ab40-91a8424a0705', 'f6705170-58ac-456b-99c6-9d36829cfeca', 'a30035af-7284-45ea-aa1f-a189cf5311fc', '21cb3633-17f4-47f6-b0c3-4263e0e499b6', 'de4557e9-9a44-4482-869f-e690653fe59e', 'ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4', 'f149ebe9-de13-482c-885e-b787b9881cd4', '901fa1df-3975-439c-91f8-bc49d2f46c89', 'eb72a34f-bda3-4818-a17c-194f6b875921', '9415ceef-7d41-4ca8-9473-e649728f53f9', '6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80', 'ef75b626-5ac5-4f1b-bccb-30d1c66c9174', '0a105954-38cf-4ea3-9175-f0a7478feadd', '575bfa27-1492-4754-bbae-fa15d2d40215', 'cc6d0e84-a7cf-49a8-8525-71f68e22792c', '86e61356-708b-403e-ad42-c5f9a1dc7099', 'cad2f7bd-5440-41f4-8c8a-0a54a291c118', '5546cce7-b8e5-406f-8abd-1541b01097c9', 'a92ae96e-10c4-4e29-8e7f-609600f2de2e', '9b2663bd-4c5a-4280-b2b0-ccd214332642', '9acb2cb2-9e67-4059-8899-02421dd18f5c', '527845fc-1b66-4f17-85ee-b1fc80f19f8e', 'e668c0d3-6bc9-4aa1-941b-9707aedef834', 'dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a', '775da0ad-e96e-41a5-a2df-bf309e71cba6', 'e152fef8-1030-4523-b8a3-d71ee61ec9e1', '225b293b-1569-42d6-87b8-ea54b1fed92d'} {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.305873] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1268.328240] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.328437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.328437] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.328665] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.328795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.329169] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1268.329169] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.329169] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1268.411322] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.411473] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.411543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.411756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.412946] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.413303] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1268.413303] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.413460] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1268.413460] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1268.413533] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1268.413566] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGH for action security_group_rules [ 1268.413635] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGH for action security_group_rules [ 1268.413702] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGH for action security_group_rules [ 1268.413765] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGH for action security_group_rules [ 1268.413827] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGH for action security_group_rules [ 1268.413888] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGH for action security_group_rules [ 1268.413949] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGH for action security_group_rules [ 1268.414017] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGH for action security_group_rules [ 1268.414079] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGH for action security_group_rules [ 1268.414141] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGH for action security_group_rules [ 1268.414239] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGH for action security_group_rules [ 1268.414274] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGH for action security_group_rules [ 1268.414310] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGH for action security_group_rules [ 1268.414363] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGH for action security_group_rules [ 1268.414423] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGH for action security_group_rules [ 1268.414484] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGH for action security_group_rules [ 1268.414546] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGH for action security_group_rules [ 1268.414609] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGH for action security_group_rules [ 1268.414672] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGH for action security_group_rules [ 1268.414764] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGH for action security_group_rules [ 1268.414828] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.722411] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.722613] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1268.722745] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb with Priority: HIGH for action security_group_rules [ 1268.722939] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 with Priority: HIGH for action security_group_rules [ 1268.723121] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGH for action security_group_rules [ 1268.723279] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 with Priority: HIGH for action security_group_rules [ 1268.723432] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30035af-7284-45ea-aa1f-a189cf5311fc with Priority: HIGH for action security_group_rules [ 1268.723633] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6705170-58ac-456b-99c6-9d36829cfeca with Priority: HIGH for action security_group_rules [ 1268.723726] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 with Priority: HIGH for action security_group_rules [ 1268.723875] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e4307b-44db-4d05-8640-bb1b3523e887 with Priority: HIGH for action security_group_rules [ 1268.724033] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a06f441-5f17-4ab5-b491-331edf1151db with Priority: HIGH for action security_group_rules [ 1268.724191] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c with Priority: HIGH for action security_group_rules [ 1268.724336] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbcba73-4b06-4756-bd56-81b58777d093 with Priority: HIGH for action security_group_rules [ 1268.724478] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGH for action security_group_rules [ 1268.724653] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da44bcac-8dcd-43ae-b931-eee44940a29b with Priority: HIGH for action security_group_rules [ 1268.724819] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a with Priority: HIGH for action security_group_rules [ 1268.724964] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 with Priority: HIGH for action security_group_rules [ 1268.725124] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 with Priority: HIGH for action security_group_rules [ 1268.725267] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f with Priority: HIGH for action security_group_rules [ 1268.725410] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b with Priority: HIGH for action security_group_rules [ 1268.725548] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 with Priority: HIGH for action security_group_rules [ 1268.725697] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332826ee-e169-4398-8162-f86ad56e690d with Priority: HIGH for action security_group_rules [ 1268.726227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.726423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.726525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.726979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.727128] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaef59ac-b94f-47d8-8852-ec864d2e9eeb',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.729106] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.729304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.729408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.729688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.729811] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaaf560a-6fd3-465d-97f1-23540c20f1b1',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.731227] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.731227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.731227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.731383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.731491] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.732490] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3402fe38-bb82-4e23-ab22-23f54a22de87 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.732649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.732765] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.733085] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.733085] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3402fe38-bb82-4e23-ab22-23f54a22de87',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.734057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a30035af-7284-45ea-aa1f-a189cf5311fc taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.734444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.734444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.734816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.734816] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a30035af-7284-45ea-aa1f-a189cf5311fc',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.735702] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6705170-58ac-456b-99c6-9d36829cfeca taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.736220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.736220] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.736335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.736410] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6705170-58ac-456b-99c6-9d36829cfeca',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.737673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.737780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.737879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.738480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.738480] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd3df8d-5b7a-444b-ab40-91a8424a0705',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.739415] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51e4307b-44db-4d05-8640-bb1b3523e887 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.739531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.739619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.739841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.739957] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51e4307b-44db-4d05-8640-bb1b3523e887',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.740933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a06f441-5f17-4ab5-b491-331edf1151db taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.741304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.741304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.741406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.741512] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a06f441-5f17-4ab5-b491-331edf1151db',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.742625] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.742756] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.742860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.743090] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.743247] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8aaa9b-7467-48c3-bfb1-e630aeec084c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.744343] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dbcba73-4b06-4756-bd56-81b58777d093 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.744343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.744484] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.744674] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.744805] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dbcba73-4b06-4756-bd56-81b58777d093',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.745841] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.745994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.746230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.746347] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.746524] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.747771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da44bcac-8dcd-43ae-b931-eee44940a29b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.749079] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.749329] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.749602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.749725] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da44bcac-8dcd-43ae-b931-eee44940a29b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.750985] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.751365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.751365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.751486] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.751647] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.752682] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb098160-f09b-4c92-93a4-fb3bb43d9826 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.752895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.752937] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.753263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.753464] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb098160-f09b-4c92-93a4-fb3bb43d9826',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.754395] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b604088e-8278-4c35-a94f-fc57fbebf7a4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.754507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.754585] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.754816] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.755712] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b604088e-8278-4c35-a94f-fc57fbebf7a4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.756211] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.756839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.756839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.756839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.756839] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cecee2b-3b4b-4faf-a5cb-ce4521ea583f',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.757892] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e872372-e4f2-43b5-922d-ee045d8baf5b taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.758058] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.758268] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.758313] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.758484] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e872372-e4f2-43b5-922d-ee045d8baf5b',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.759477] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.759641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.759762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.759968] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.760098] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95dbc5ce-23c5-4cf9-a9a6-b4703d803c63',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.761312] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-332826ee-e169-4398-8162-f86ad56e690d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.761468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.761568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.761798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.761909] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('332826ee-e169-4398-8162-f86ad56e690d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.769496] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.769612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.769694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.769970] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.770219] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.770806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.770806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.770806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.770806] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.771113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.771113] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.806445] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.806698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.806799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.807113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.817897] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.817897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.829308] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.829784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.830347] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.830443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.831273] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.831383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.840666] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.840845] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3402fe38-bb82-4e23-ab22-23f54a22de87 is going to be deleted. [ 1268.842272] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.842487] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.893122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.893446] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaaf560a-6fd3-465d-97f1-23540c20f1b1 is going to be deleted. [ 1268.894979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.894979] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.925858] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.926091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.930020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.930020] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8aaa9b-7467-48c3-bfb1-e630aeec084c is going to be deleted. [ 1268.930020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.930020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.957389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.957711] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd3df8d-5b7a-444b-ab40-91a8424a0705 is going to be deleted. [ 1268.958914] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.959119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.992499] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.993020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.003605] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.003605] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6705170-58ac-456b-99c6-9d36829cfeca is going to be deleted. [ 1269.004490] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.004701] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.004826] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.004925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3402fe38-bb82-4e23-ab22-23f54a22de87" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.005101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.005271] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.005346] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.005460] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaaf560a-6fd3-465d-97f1-23540c20f1b1" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.027033] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.027033] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.027221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.028034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.028034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.028034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8aaa9b-7467-48c3-bfb1-e630aeec084c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.086625] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.086800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.086870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.087135] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.087236] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.087377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd3df8d-5b7a-444b-ab40-91a8424a0705" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.108954] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.108954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.108954] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.109270] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.109334] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.109509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6705170-58ac-456b-99c6-9d36829cfeca" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.278632] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.279106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.279106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.279106] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.279328] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.279328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.279441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.279516] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.279610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.279693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.279779] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.286501] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.339212] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.339423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.339423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.339668] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.341810] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.341918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.343240] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.343337] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.346705] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.346831] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.351673] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.351876] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.352867] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.352998] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.353768] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.353892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.354786] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.354896] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.356368] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.356630] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.357230] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.357327] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.358242] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.358360] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.358628] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.359303] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.359426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.360283] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.360798] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.360891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.381652] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.382262] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.382441] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a06f441-5f17-4ab5-b491-331edf1151db is going to be deleted. [ 1269.383458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.383683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.404387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.404569] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51e4307b-44db-4d05-8640-bb1b3523e887 is going to be deleted. [ 1269.405689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.405885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.432657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.432872] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b604088e-8278-4c35-a94f-fc57fbebf7a4 is going to be deleted. [ 1269.434543] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.434768] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.463589] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.463808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.472161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.472399] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e872372-e4f2-43b5-922d-ee045d8baf5b is going to be deleted. [ 1269.473823] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.474187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.476342] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.476525] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.495988] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.496200] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cecee2b-3b4b-4faf-a5cb-ce4521ea583f is going to be deleted. [ 1269.496982] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.497214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.512038] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.512178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.520288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.520419] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a30035af-7284-45ea-aa1f-a189cf5311fc is going to be deleted. [ 1269.521343] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.521568] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.561942] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.562162] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.590727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.590876] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaef59ac-b94f-47d8-8852-ec864d2e9eeb is going to be deleted. [ 1269.591800] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.592026] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.630125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.630305] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dbcba73-4b06-4756-bd56-81b58777d093 is going to be deleted. [ 1269.631471] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.631712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.633244] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.633349] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.709292] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.709515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.711150] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.711258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.746506] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.746682] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb098160-f09b-4c92-93a4-fb3bb43d9826 is going to be deleted. [ 1269.748112] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.748339] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.784338] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.793354] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2604d13b-747f-46b6-934c-17fb07504709: rpc.has_security_group_logging(os_id): False [ 1269.812137] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.812373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.834165] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.834439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.841888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.842064] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a is going to be deleted. [ 1269.843046] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.843281] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.896983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.897149] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 332826ee-e169-4398-8162-f86ad56e690d is going to be deleted. [ 1269.898685] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.899039] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.900972] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.901138] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.955558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.956307] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da44bcac-8dcd-43ae-b931-eee44940a29b is going to be deleted. [ 1269.957289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.957686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.027593] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.027593] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95dbc5ce-23c5-4cf9-a9a6-b4703d803c63 is going to be deleted. [ 1270.028891] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.029157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.029260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.029394] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a06f441-5f17-4ab5-b491-331edf1151db" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.029602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.029773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.029870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.030105] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51e4307b-44db-4d05-8640-bb1b3523e887" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.030570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.030735] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.030817] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.030950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b604088e-8278-4c35-a94f-fc57fbebf7a4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.031114] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.031260] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.031333] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.031442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e872372-e4f2-43b5-922d-ee045d8baf5b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.031564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.031752] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.031829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.031935] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cecee2b-3b4b-4faf-a5cb-ce4521ea583f" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.032172] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.032319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.032399] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.032513] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaef59ac-b94f-47d8-8852-ec864d2e9eeb" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.032638] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.032789] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.032990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.033121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a30035af-7284-45ea-aa1f-a189cf5311fc" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.033241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.033400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.033466] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.033575] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dbcba73-4b06-4756-bd56-81b58777d093" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.033697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.033833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.077561] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.077799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.078542] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.078670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.152156] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.152383] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.159148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.159725] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.159899] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.159974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.160201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.160305] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.160449] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1270.161743] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.161949] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.162052] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.162178] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb098160-f09b-4c92-93a4-fb3bb43d9826" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.162359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.162572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.162716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.162930] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc2f613-f4f1-4590-aa33-4d58dfb0bf7a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.163063] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.163252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.163369] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.163564] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-332826ee-e169-4398-8162-f86ad56e690d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.163687] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.163851] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.163929] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.164035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da44bcac-8dcd-43ae-b931-eee44940a29b" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.209369] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.209544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.209637] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.209845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.210012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.210113] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95dbc5ce-23c5-4cf9-a9a6-b4703d803c63" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.287382] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5: rpc.has_security_group_logging(os_id): False [ 1270.327384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.327606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.327606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.328034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.343771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.343972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.366894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.367319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.367465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.367545] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.367827] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.367932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.368059] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 is going to be updated. [ 1270.369480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.369746] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.369910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.409873] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1270.466071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.466384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.466384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.466537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.466681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.493061] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: IN_PROGRESS for 2s [ 1271.776515] env[65660]: INFO networking_nsxv3.common.synchronization [req-6ac306d2-b505-4321-a15a-1028ef96ea91 req-e6ab2c8a-0ad1-4ff5-961d-e9b91a8256cf tempest-ServerActionsTestOtherA-61028757 tempest-ServerActionsTestOtherA-61028757-project-member] Enqueued Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1271.777141] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225b293b-1569-42d6-87b8-ea54b1fed92d with Priority: HIGHEST for action security_group_members [ 1271.777479] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-225b293b-1569-42d6-87b8-ea54b1fed92d taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.777725] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.777793] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.777961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.778143] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.778243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.778303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.778445] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.778528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.778618] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225b293b-1569-42d6-87b8-ea54b1fed92d',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.283240] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.283507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.283507] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.283693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.311522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.312303] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.312303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.312303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.312303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.312303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.312611] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d is going to be updated. [ 1272.343545] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.343700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.343777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.344040] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.344188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.355478] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: IN_PROGRESS for 2s [ 1272.425150] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1272.425454] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.504277] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: SUCCESS [ 1272.504524] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.367059] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225b293b-1569-42d6-87b8-ea54b1fed92d in Status: SUCCESS [ 1274.367059] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225b293b-1569-42d6-87b8-ea54b1fed92d deletion is rescheduled due to dependency. [ 1274.367059] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225b293b-1569-42d6-87b8-ea54b1fed92d" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.779434] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.779829] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.780639] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.780639] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.281084] env[65660]: INFO networking_nsxv3.common.synchronization [req-5077f8e0-a858-44e5-8260-6b4abc1e308b req-204f3399-81a1-45a2-93e7-7ee7c2ecb577 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1285.281704] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1285.282069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.282221] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.282298] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.282529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.283077] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.283207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.283287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.283482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.283583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.283677] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.424943] env[65660]: INFO networking_nsxv3.common.synchronization [req-9a6d36a9-0ac9-4ed2-af61-8ed114ddc0e3 req-94451bd0-af89-47a5-bfc2-a93345acd3f0 tempest-AttachVolumeTestJSON-837886045 tempest-AttachVolumeTestJSON-837886045-project-member] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_members [ 1285.426433] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGHEST for action security_group_members [ 1285.426766] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.426885] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.426958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.427181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.427329] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.427425] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.427480] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.427625] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.427707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.427832] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.787057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.787057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.787057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.787057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.787057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.787057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.787057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.787057] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.787559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.787559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.787559] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1285.818353] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.818565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.818565] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.818689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.818842] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.839479] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1285.930259] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.930444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.930573] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.930728] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.957323] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.957658] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.957840] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.957952] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.958214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.958307] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.958403] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 is going to be updated. [ 1285.992184] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.992388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.992388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.992608] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.992762] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.001939] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 in Status: IN_PROGRESS for 2s [ 1287.851265] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1287.851627] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 deletion is rescheduled due to dependency. [ 1287.851627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.014650] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 in Status: SUCCESS [ 1288.014935] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 deletion is rescheduled due to dependency. [ 1288.015088] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.427631] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.427631] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.608908] env[65660]: INFO networking_nsxv3.common.synchronization [req-298bc83b-7b56-40f9-9f97-13f9dc403113 req-ab53108d-5317-4574-9646-e148c8b1bd71 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1292.609351] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1292.609700] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.609849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.609918] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.610183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.610377] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.610494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.610572] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.610727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.610829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.610926] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.917523] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.918074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.918074] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.918222] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.918505] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.918680] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.918801] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.919031] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.919182] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.919449] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.919596] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.919703] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.919847] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.920105] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.920280] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.920425] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.941676] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.941855] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1292.942010] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.942207] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-885" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.942564] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-d3d05498-b049-4cbb-bc88-94b6c04cadf7 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.942740] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.942859] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.943254] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.943398] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3d05498-b049-4cbb-bc88-94b6c04cadf7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.113902] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.114146] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.114241] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.114515] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.114624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.114864] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.114974] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.115070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.115265] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.115354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.115449] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1293.142394] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.142618] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.142686] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.142881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.143076] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.152777] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1293.445745] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.446137] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.446278] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.446701] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.446869] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.447057] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port d3d05498-b049-4cbb-bc88-94b6c04cadf7 not found, creating... [ 1293.447339] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.447501] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.447636] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.447881] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.448073] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.448374] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.448538] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.448656] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.448987] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.449098] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.449223] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: d3d05498-b049-4cbb-bc88-94b6c04cadf7 is going to be created. [ 1293.473061] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.473303] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.473401] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.473688] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.473992] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.474249] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.184366] env[65660]: INFO networking_nsxv3.common.synchronization [req-298bc83b-7b56-40f9-9f97-13f9dc403113 req-264a948f-161f-45fc-9eeb-19b241392148 service nova] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 1294.184637] env[65660]: INFO networking_nsxv3.common.synchronization [req-298bc83b-7b56-40f9-9f97-13f9dc403113 req-264a948f-161f-45fc-9eeb-19b241392148 service nova] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1294.184763] env[65660]: INFO networking_nsxv3.common.synchronization [req-298bc83b-7b56-40f9-9f97-13f9dc403113 req-264a948f-161f-45fc-9eeb-19b241392148 service nova] Enqueued Resource ID: d3d05498-b049-4cbb-bc88-94b6c04cadf7 with Priority: HIGHEST for action port [ 1294.185233] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_rules [ 1294.185381] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1294.185468] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3d05498-b049-4cbb-bc88-94b6c04cadf7 with Priority: HIGHEST for action port [ 1294.186243] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.186458] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.186503] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.186673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.186755] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.187618] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.187707] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.187918] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3d05498-b049-4cbb-bc88-94b6c04cadf7 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.188054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.188119] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.188289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.188400] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3d05498-b049-4cbb-bc88-94b6c04cadf7',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.689835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.690148] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.690200] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3d05498-b049-4cbb-bc88-94b6c04cadf7 with status ACTIVE [ 1294.690382] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.690495] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.690561] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.690780] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.690868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.691058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.691157] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.691228] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.691388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.691456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.691641] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.691734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.691795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.691934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.692016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.692100] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3d05498-b049-4cbb-bc88-94b6c04cadf7 is going to be updated. [ 1294.715058] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.715295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.715295] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.715489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.715628] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.715818] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3d05498-b049-4cbb-bc88-94b6c04cadf7" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.162392] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1295.162585] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 deletion is rescheduled due to dependency. [ 1295.162712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.162835] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.163082] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.163268] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.163384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.163456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.163613] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.163694] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.163893] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.666381] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.169348] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.672226] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.672609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.672609] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.672690] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.672795] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.672875] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1296.703724] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.703874] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.703950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.704373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.704600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.714866] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1298.727176] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1298.727547] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.727586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.728317] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.728663] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.728862] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.728957] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.729218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.729361] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.729476] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.729576] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.188392] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.188392] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1299.231983] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.735380] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2604d13b-747f-46b6-934c-17fb07504709: rpc.has_security_group_logging(os_id): False [ 1299.755012] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.755940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.755940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.755940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.755940] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.757653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.757653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.757653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.757653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.757653] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.757653] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1299.820024] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.820024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.820024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.820024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.820024] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.835641] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1301.852396] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1301.852786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.188804] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.189216] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.726161] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.726482] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.726482] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.726751] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.727019] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.727174] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.727291] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.727497] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.727636] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.727837] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.727951] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.728089] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.728205] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.728321] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.728428] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.728585] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.749723] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.749891] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1307.750035] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.750230] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-620" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.750657] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-e0bf3688-7174-47b7-b550-62713303152c taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.750848] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.750956] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.751232] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.751369] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0bf3688-7174-47b7-b550-62713303152c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.255296] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.255584] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.255861] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.256307] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.256553] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.256964] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.257268] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.257464] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.257772] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.257986] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.258370] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.258594] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.258754] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.259009] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.259207] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.259406] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: e0bf3688-7174-47b7-b550-62713303152c is going to be updated. [ 1308.283979] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.284323] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.284451] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.284734] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.284918] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.285161] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.975703] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0633e6f-e15b-4ab9-ba1f-8b3bb1feebdd req-a4bbd96c-21fb-458e-bdad-39ae7102d589 service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 1308.976018] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0633e6f-e15b-4ab9-ba1f-8b3bb1feebdd req-a4bbd96c-21fb-458e-bdad-39ae7102d589 service nova] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1308.976018] env[65660]: INFO networking_nsxv3.common.synchronization [req-f0633e6f-e15b-4ab9-ba1f-8b3bb1feebdd req-a4bbd96c-21fb-458e-bdad-39ae7102d589 service nova] Enqueued Resource ID: e0bf3688-7174-47b7-b550-62713303152c with Priority: HIGHEST for action port [ 1308.976538] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_rules [ 1308.976672] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1308.976767] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0bf3688-7174-47b7-b550-62713303152c with Priority: HIGHEST for action port [ 1308.977047] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.977170] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.977238] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.977431] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.977511] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.978384] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.978477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.978790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.978790] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.978910] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.978910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.979030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.979110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.979216] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.979345] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.980522] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0bf3688-7174-47b7-b550-62713303152c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.980522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.980614] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.980706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.980786] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0bf3688-7174-47b7-b550-62713303152c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.482657] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.482905] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.484390] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.485381] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0bf3688-7174-47b7-b550-62713303152c with status ACTIVE [ 1309.485584] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.485712] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.485781] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.485994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.486101] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.486282] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.486380] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.486450] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.486606] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.486683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.486856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.486949] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.487021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.487165] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.487242] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.487369] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0bf3688-7174-47b7-b550-62713303152c is going to be updated. [ 1309.510767] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.510985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.511038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.511214] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.511354] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.511514] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0bf3688-7174-47b7-b550-62713303152c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.989859] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.492303] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.492540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.492540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.492747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.492824] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.492933] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1310.525610] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.525921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.525921] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.526121] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.526282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.537741] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1312.548112] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1312.548492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.548492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.548808] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.549071] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.549245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.549325] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.549493] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.549595] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.549679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.549771] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.052447] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.555371] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f149ebe9-de13-482c-885e-b787b9881cd4: rpc.has_security_group_logging(os_id): False [ 1313.591617] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.591888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.591888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.592144] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.615839] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.616290] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.616421] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.616488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.616697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.616786] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.616876] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1313.708069] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.708331] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.708412] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.708634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.708784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.726677] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1313.978094] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.978260] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1315.742985] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1315.743586] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.979051] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.979439] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.980539] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.980927] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.067278] env[65660]: INFO networking_nsxv3.common.synchronization [req-b0e21ec8-78c8-4b23-b15f-c4ba391f240d req-3eb58389-ddc1-4542-a257-0a459f54cce2 tempest-ServerActionsTestOtherB-1540585961 tempest-ServerActionsTestOtherB-1540585961-project-member] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1324.067831] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGHEST for action security_group_members [ 1324.068150] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.068301] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.068393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.068570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.068709] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.068815] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.068868] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.069489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.069489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.069489] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.571487] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.571641] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.571706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.571919] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.572017] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.572199] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.572297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.572359] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.572504] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.572578] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.572660] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be updated. [ 1324.602389] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.602657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.602657] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.602803] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.602956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.612034] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: IN_PROGRESS for 2s [ 1326.623388] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f149ebe9-de13-482c-885e-b787b9881cd4 in Status: SUCCESS [ 1326.623388] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 deletion is rescheduled due to dependency. [ 1326.623388] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.069381] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.069787] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1334.070788] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.071212] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.868562] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.868917] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.868967] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.869357] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.869666] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.869831] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.869947] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.870179] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.870322] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.870537] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1338.870647] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1338.870752] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1338.870856] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1338.870960] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1338.871078] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1338.871210] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1338.890916] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1338.891088] env[65660]: DEBUG dogpile.cache.region [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1338.891211] env[65660]: DEBUG dogpile.lock [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1338.891374] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.891680] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock port-eaf5b027-661f-4ea5-bd21-a82c7ef11192 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.891846] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.891960] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.892233] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.892371] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf5b027-661f-4ea5-bd21-a82c7ef11192',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.071939] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1339.072145] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.394784] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.395032] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.395162] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.395452] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.395606] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.395888] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.396092] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.396173] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.396410] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.396557] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.396842] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.397115] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.397115] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.397309] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.397437] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.397578] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Resource: SegmentPort with ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 is going to be updated. [ 1339.418870] env[65660]: DEBUG networking_nsxv3.common.locking [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.419152] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.419229] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.419466] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.419683] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.419934] env[65660]: DEBUG oslo_concurrency.lockutils [None req-6211eb32-d86c-4ea8-8ddf-a9cb5759e3a1 None None] Releasing lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.105644] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe8c57e7-642e-44b2-b6d3-b84c244841e7 req-27f5fe34-e1e3-49ce-8a3a-98886861542c service nova] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1340.105894] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe8c57e7-642e-44b2-b6d3-b84c244841e7 req-27f5fe34-e1e3-49ce-8a3a-98886861542c service nova] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1340.106018] env[65660]: INFO networking_nsxv3.common.synchronization [req-fe8c57e7-642e-44b2-b6d3-b84c244841e7 req-27f5fe34-e1e3-49ce-8a3a-98886861542c service nova] Enqueued Resource ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 with Priority: HIGHEST for action port [ 1340.106573] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_rules [ 1340.106737] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1340.106840] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 with Priority: HIGHEST for action port [ 1340.107134] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.107277] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.107348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.107590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.107657] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.108473] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.108943] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.109054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.109820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.109820] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.109820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.109820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.109820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.109820] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.110138] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.110876] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaf5b027-661f-4ea5-bd21-a82c7ef11192 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.111204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.111204] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.111276] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.111348] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf5b027-661f-4ea5-bd21-a82c7ef11192',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.613011] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.614251] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.614366] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.614761] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaf5b027-661f-4ea5-bd21-a82c7ef11192 with status ACTIVE [ 1340.615043] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.615250] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.615416] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.615688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.615787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.616015] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.616118] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.616180] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.616401] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.616529] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.616780] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.616922] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.617022] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.617243] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.617370] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.617493] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaf5b027-661f-4ea5-bd21-a82c7ef11192 is going to be updated. [ 1340.640709] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.640959] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.641093] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.641405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.641645] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.641901] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaf5b027-661f-4ea5-bd21-a82c7ef11192" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.116215] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.618456] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.618683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.618683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.618910] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.619029] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.619133] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 is going to be updated. [ 1341.646827] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.647050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.647050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.647193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.647372] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.656522] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: IN_PROGRESS for 2s [ 1343.668564] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: SUCCESS [ 1343.668978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.668978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.669269] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.669488] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.669679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.669679] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.669845] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.669917] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.670030] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.670125] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.172752] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.674713] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5: rpc.has_security_group_logging(os_id): False [ 1344.706897] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.707035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.707035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.707291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.707390] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.707783] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.707916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.707958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.708200] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.708316] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.708489] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 is going to be updated. [ 1344.809021] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.809375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.809375] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.809717] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.809916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.828963] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: IN_PROGRESS for 2s [ 1345.108068] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.108068] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1346.845852] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: SUCCESS [ 1346.846222] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.109695] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.110109] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.151629] env[65660]: INFO networking_nsxv3.common.synchronization [req-8c5a3f7b-22fb-4eb6-855b-a736867275ab req-e34b1489-dbb5-4431-ac31-19f66493e742 tempest-ServerActionsTestJSON-824544025 tempest-ServerActionsTestJSON-824544025-project-member] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1354.152261] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGHEST for action security_group_members [ 1354.152552] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.152632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.152688] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.153060] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.153060] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.153161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.153161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.153878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.153878] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.153878] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.655777] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.656034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.656092] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.656328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.656462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.656720] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.656858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.656858] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.657066] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.657159] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.657250] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be updated. [ 1354.685057] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.685308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.685308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.685432] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.685570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.694354] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: IN_PROGRESS for 2s [ 1356.706818] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2604d13b-747f-46b6-934c-17fb07504709 in Status: SUCCESS [ 1356.706818] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2604d13b-747f-46b6-934c-17fb07504709 deletion is rescheduled due to dependency. [ 1356.707319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.153189] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.153541] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.153991] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.154438] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.155465] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.155855] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.157326] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.157711] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.158020] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.158465] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.158796] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.159237] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.160339] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.160763] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.161257] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.161652] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.842546] env[65660]: INFO networking_nsxv3.common.synchronization [req-2336d166-02a7-409a-a2b8-3d993b19ecb7 req-deb9723a-e398-4562-9f06-6fa0e64c4140 tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1398.843468] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 with Priority: HIGHEST for action security_group_members [ 1398.843914] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.844671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.844671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.844671] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.844671] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.844902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.844902] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.845018] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.845459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.845459] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.348095] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.348345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.348345] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.348533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.348612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.349067] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.349067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.349067] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.349389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.349389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.349389] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 is going to be updated. [ 1399.378263] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.378539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.378539] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.378634] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.378759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.386367] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: IN_PROGRESS for 2s [ 1401.397530] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 in Status: SUCCESS [ 1401.397920] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5 deletion is rescheduled due to dependency. [ 1401.397920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.525017] env[65660]: INFO networking_nsxv3.common.synchronization [None req-9d7c59da-a4c7-44ee-9a68-7299793a8e1b tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1403.525625] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1403.525880] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.526016] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.526091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.526342] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.526425] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.620379] env[65660]: INFO networking_nsxv3.common.synchronization [None req-d15643ef-ccf9-42e1-a995-07282408bd65 tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1403.620599] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1403.620821] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.620924] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.047881] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.047881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.047881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.047881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.047881] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.048215] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 already deleted. [ 1404.048215] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.048287] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.048494] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.048614] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.568766] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.569194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.569194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.569194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.569395] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.569395] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 already deleted. [ 1404.569459] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.622190] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.622471] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.918255] env[65660]: INFO networking_nsxv3.common.synchronization [req-7210f9ef-86c9-4317-9f8a-4ea96fb0d300 req-ba124db0-b908-4290-a09a-4aa855459bfa tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1408.918558] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1408.918879] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.919012] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.919102] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.919353] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.919506] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.919602] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.919663] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.919805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.919886] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.919976] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.191684] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.191890] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.192026] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.192307] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.192560] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.192711] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.192827] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.193050] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.193194] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.193395] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1409.193507] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1409.193614] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1409.193719] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1409.193823] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1409.193925] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1409.194066] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1409.214427] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1409.214604] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1409.214708] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1409.214873] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.215198] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-c9f5fb1d-e6b0-4156-99da-aa23361112cd taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.215369] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.215487] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.215800] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.215941] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5fb1d-e6b0-4156-99da-aa23361112cd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.422492] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.422683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.422683] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.422898] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.423075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.423299] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.423428] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.423512] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.423695] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.423798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.423902] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 already deleted. [ 1409.424011] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.717814] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.718132] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.718184] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.718551] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.718718] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.718877] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Segment Port c9f5fb1d-e6b0-4156-99da-aa23361112cd not found, creating... [ 1409.719163] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.719329] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.719445] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.719660] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.719792] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.720086] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.720313] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.720463] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.720731] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.720874] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.721019] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd is going to be created. [ 1409.742566] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.742781] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.742907] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.743197] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.743427] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.743648] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.422249] env[65660]: INFO networking_nsxv3.common.synchronization [req-7210f9ef-86c9-4317-9f8a-4ea96fb0d300 req-92050e71-ce12-47e1-9a61-759d34f60732 service nova] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1410.422433] env[65660]: INFO networking_nsxv3.common.synchronization [req-7210f9ef-86c9-4317-9f8a-4ea96fb0d300 req-92050e71-ce12-47e1-9a61-759d34f60732 service nova] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1410.422573] env[65660]: INFO networking_nsxv3.common.synchronization [req-7210f9ef-86c9-4317-9f8a-4ea96fb0d300 req-92050e71-ce12-47e1-9a61-759d34f60732 service nova] Enqueued Resource ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd with Priority: HIGHEST for action port [ 1410.423086] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1410.423223] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1410.423320] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd with Priority: HIGHEST for action port [ 1410.423589] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.423732] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.423770] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.424013] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.424100] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.425304] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.425420] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.425489] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.425654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.425803] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.425897] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.425958] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.426111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.426194] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.426281] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.426965] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f5fb1d-e6b0-4156-99da-aa23361112cd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.428207] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.428335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.428447] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.428524] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5fb1d-e6b0-4156-99da-aa23361112cd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.926174] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.926546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.929657] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.931025] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9f5fb1d-e6b0-4156-99da-aa23361112cd with status ACTIVE [ 1410.931218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.931433] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.931496] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.931811] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.931916] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.932191] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.933047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.933047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.933047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.933047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.933047] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.933047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.933047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.933385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.933385] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.933385] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd is going to be updated. [ 1410.955319] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.955517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.955517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.955706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.955836] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.955989] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.436508] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.939039] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.939423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.939423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.939423] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.939531] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.939630] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 is going to be created. [ 1411.966579] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.966720] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.966805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.966983] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.967153] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.976652] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: UNINITIALIZED for 2s [ 1413.988111] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: SUCCESS [ 1413.988632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.988632] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.988750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.988856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.988976] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.989050] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.989240] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.989321] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.989400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.989489] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.492381] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.995458] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4a85b3c-448d-4d7e-95a4-8b0306701612: rpc.has_security_group_logging(os_id): False [ 1415.013099] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.013297] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.013348] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.013534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.013624] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.013873] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.013972] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.014070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.014201] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.014389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.014389] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 is going to be created. [ 1415.080731] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.080950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.080950] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.081158] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.081340] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.091565] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: IN_PROGRESS for 2s [ 1415.424479] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.424479] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1417.105168] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: SUCCESS [ 1417.105619] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.426080] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.426080] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.427310] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.427702] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.428382] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.428852] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.429577] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.429942] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.430981] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.431476] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.432315] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.432711] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.433816] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.434251] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.435062] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.435062] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.436493] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.436493] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.437998] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.438459] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.439273] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.439765] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.441072] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.441439] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.442408] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.442802] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.164979] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.165277] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.165360] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.165647] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.166376] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.166576] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.166669] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.166888] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.167046] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.167255] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1482.167371] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] NeedRegenerationException {{(pid=65660) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1482.167478] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] no value, waiting for create lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1482.167586] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] value creation lock acquired {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1482.167709] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] No value present for key: 'zone-id' {{(pid=65660) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1482.167837] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Calling creation function for not-yet-present value {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1482.167981] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1482.197349] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1482.197534] env[65660]: DEBUG dogpile.cache.region [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65660) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1482.197671] env[65660]: DEBUG dogpile.lock [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Released creation lock {{(pid=65660) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1482.197887] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "network-287" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.198255] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock port-c9f5fb1d-e6b0-4156-99da-aa23361112cd taken with stack trace [, , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.198432] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.198564] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.198844] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.198978] env[65660]: DEBUG networking_nsxv3.api.rpc [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5fb1d-e6b0-4156-99da-aa23361112cd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.701600] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.701850] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.701954] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.702243] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.702402] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.702686] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.702839] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.702957] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.703222] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.703360] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.703636] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.703875] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.704029] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.704237] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.704368] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.704508] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Resource: SegmentPort with ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd is going to be updated. [ 1482.731440] env[65660]: DEBUG networking_nsxv3.common.locking [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.731716] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.731847] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.732140] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.732324] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.732603] env[65660]: DEBUG oslo_concurrency.lockutils [None req-439bce48-5497-4632-8063-e5358a1cfa0c None None] Releasing lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.425851] env[65660]: INFO networking_nsxv3.common.synchronization [req-114f3d79-0999-4366-8df7-bda83d974bab req-eadfd114-ba2d-4906-a0b1-5700f961b750 service nova] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1483.426143] env[65660]: INFO networking_nsxv3.common.synchronization [req-114f3d79-0999-4366-8df7-bda83d974bab req-eadfd114-ba2d-4906-a0b1-5700f961b750 service nova] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1483.426244] env[65660]: INFO networking_nsxv3.common.synchronization [req-114f3d79-0999-4366-8df7-bda83d974bab req-eadfd114-ba2d-4906-a0b1-5700f961b750 service nova] Enqueued Resource ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd with Priority: HIGHEST for action port [ 1483.426692] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_rules [ 1483.426824] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1483.426918] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd with Priority: HIGHEST for action port [ 1483.427346] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.427477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.427540] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.427787] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.427848] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.429420] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.429537] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.429600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.429813] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.429949] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.430053] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.430125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.430254] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.430367] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.430419] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.431147] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f5fb1d-e6b0-4156-99da-aa23361112cd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.431253] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.431371] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.431469] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.431535] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f5fb1d-e6b0-4156-99da-aa23361112cd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.930485] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.930697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.932935] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.934066] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9f5fb1d-e6b0-4156-99da-aa23361112cd with status ACTIVE [ 1483.934066] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.934289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.934289] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.934456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.934544] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.934708] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.934805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.934869] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.935036] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.935116] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.935287] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.935400] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.935456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.935604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.935677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.935760] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9f5fb1d-e6b0-4156-99da-aa23361112cd is going to be updated. [ 1483.957605] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.957772] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.957843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.958037] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.958187] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.958338] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f5fb1d-e6b0-4156-99da-aa23361112cd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.438126] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.940274] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.940511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.940511] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.940660] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.940750] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.940853] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 is going to be updated. [ 1484.972737] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.972994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.972994] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.973161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.973309] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.984045] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: IN_PROGRESS for 2s [ 1486.995300] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: SUCCESS [ 1486.995597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.995677] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.995894] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.996102] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.996218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.996283] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.996443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.996519] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.996604] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.996692] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.499475] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.002722] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4a85b3c-448d-4d7e-95a4-8b0306701612: rpc.has_security_group_logging(os_id): False [ 1488.021487] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.021700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.021700] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.021892] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.021977] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.022268] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.022373] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.022434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.022583] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.022658] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.022742] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 is going to be updated. [ 1488.095422] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.095673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.095673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.095864] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.095971] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.108761] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: IN_PROGRESS for 2s [ 1488.428147] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.428471] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1490.124706] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: SUCCESS [ 1490.124706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.662822] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1490.663078] env[65660]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7cd76b61-894f-4332-ab33-e4103f70b1fe None None] NSXv3 Agent Agent loop - iteration:4 started [ 1493.429683] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.430176] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.431032] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.431413] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.432217] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.432662] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.596274] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.596714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.596714] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.596855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.596968] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.099444] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.602502] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.104832] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1507.105115] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1507.843566] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.844047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.844047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.844183] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.857415] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1507.858267] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.859024] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1507.894645] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.894860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.894860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.895086] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.909656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.910451] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1507.910555] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1507.910617] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1507.941125] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.941365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.941365] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.941534] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.942237] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.942394] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1508.015084] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.015408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.015408] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.015533] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.015843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.016274] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1508.091984] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.092247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.092247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.092426] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.092726] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.093012] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:27. [ 1508.093140] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'21cb3633-17f4-47f6-b0c3-4263e0e499b6', 'de4557e9-9a44-4482-869f-e690653fe59e', 'ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4', 'dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a', 'f149ebe9-de13-482c-885e-b787b9881cd4', '901fa1df-3975-439c-91f8-bc49d2f46c89', 'eb72a34f-bda3-4818-a17c-194f6b875921', '9415ceef-7d41-4ca8-9473-e649728f53f9', '6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80', 'ef75b626-5ac5-4f1b-bccb-30d1c66c9174', '0a105954-38cf-4ea3-9175-f0a7478feadd', '575bfa27-1492-4754-bbae-fa15d2d40215', 'cc6d0e84-a7cf-49a8-8525-71f68e22792c', '86e61356-708b-403e-ad42-c5f9a1dc7099', 'cad2f7bd-5440-41f4-8c8a-0a54a291c118', '2604d13b-747f-46b6-934c-17fb07504709', '5546cce7-b8e5-406f-8abd-1541b01097c9', '9b2663bd-4c5a-4280-b2b0-ccd214332642', '9acb2cb2-9e67-4059-8899-02421dd18f5c', '527845fc-1b66-4f17-85ee-b1fc80f19f8e', 'e668c0d3-6bc9-4aa1-941b-9707aedef834', 'a92ae96e-10c4-4e29-8e7f-609600f2de2e', '775da0ad-e96e-41a5-a2df-bf309e71cba6', '0cfd4e77-8b6b-4eb0-a554-2d46c966d2b5', 'e152fef8-1030-4523-b8a3-d71ee61ec9e1', '225b293b-1569-42d6-87b8-ea54b1fed92d', 'a4a85b3c-448d-4d7e-95a4-8b0306701612'} {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1508.093230] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1508.114273] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.114500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.114500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.114629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.114715] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.114821] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1508.114892] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1508.114967] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1508.187875] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.188125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.188125] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.188310] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.189443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.189683] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1508.189763] env[65660]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65660) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1508.189832] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1508.189896] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1508.189970] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/27 resources of Type:Security Group Rules [ 1508.190076] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGH for action security_group_rules [ 1508.190159] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGH for action security_group_rules [ 1508.190225] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGH for action security_group_rules [ 1508.190288] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGH for action security_group_rules [ 1508.190347] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGH for action security_group_rules [ 1508.190406] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGH for action security_group_rules [ 1508.190464] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGH for action security_group_rules [ 1508.190599] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGH for action security_group_rules [ 1508.190662] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGH for action security_group_rules [ 1508.190722] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGH for action security_group_rules [ 1508.190780] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGH for action security_group_rules [ 1508.190840] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGH for action security_group_rules [ 1508.190899] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGH for action security_group_rules [ 1508.190959] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGH for action security_group_rules [ 1508.191031] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGH for action security_group_rules [ 1508.191104] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGH for action security_group_rules [ 1508.191176] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGH for action security_group_rules [ 1508.191238] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGH for action security_group_rules [ 1508.191299] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGH for action security_group_rules [ 1508.191359] env[65660]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGH for action security_group_rules [ 1508.191452] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.433628] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.433848] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1508.433848] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 with Priority: HIGH for action security_group_rules [ 1508.433940] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 with Priority: HIGH for action security_group_rules [ 1508.434023] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb72a34f-bda3-4818-a17c-194f6b875921 with Priority: HIGH for action security_group_rules [ 1508.434139] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 with Priority: HIGH for action security_group_rules [ 1508.434233] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e with Priority: HIGH for action security_group_rules [ 1508.434323] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c with Priority: HIGH for action security_group_rules [ 1508.434412] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 with Priority: HIGH for action security_group_rules [ 1508.434501] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 with Priority: HIGH for action security_group_rules [ 1508.434585] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 with Priority: HIGH for action security_group_rules [ 1508.434671] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604d13b-747f-46b6-934c-17fb07504709 with Priority: HIGH for action security_group_rules [ 1508.434759] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c with Priority: HIGH for action security_group_rules [ 1508.434844] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 575bfa27-1492-4754-bbae-fa15d2d40215 with Priority: HIGH for action security_group_rules [ 1508.434928] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a105954-38cf-4ea3-9175-f0a7478feadd with Priority: HIGH for action security_group_rules [ 1508.435022] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 with Priority: HIGH for action security_group_rules [ 1508.435111] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 with Priority: HIGH for action security_group_rules [ 1508.435198] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 with Priority: HIGH for action security_group_rules [ 1508.435281] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 with Priority: HIGH for action security_group_rules [ 1508.435365] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f149ebe9-de13-482c-885e-b787b9881cd4 with Priority: HIGH for action security_group_rules [ 1508.435449] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4557e9-9a44-4482-869f-e690653fe59e with Priority: HIGH for action security_group_rules [ 1508.435533] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a with Priority: HIGH for action security_group_rules [ 1508.435872] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.436008] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.436078] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.436288] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.436372] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21cb3633-17f4-47f6-b0c3-4263e0e499b6',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.437363] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.437482] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.437549] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.437716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.437793] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.439070] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb72a34f-bda3-4818-a17c-194f6b875921 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.439070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.439070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.439070] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.439070] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb72a34f-bda3-4818-a17c-194f6b875921',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.440063] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.440175] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.440231] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.440376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.440471] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cad2f7bd-5440-41f4-8c8a-0a54a291c118',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.441405] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.441405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.441405] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.441587] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.441587] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527845fc-1b66-4f17-85ee-b1fc80f19f8e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.442167] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acb2cb2-9e67-4059-8899-02421dd18f5c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.442314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.442314] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.442468] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.442539] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acb2cb2-9e67-4059-8899-02421dd18f5c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.443222] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2663bd-4c5a-4280-b2b0-ccd214332642 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.443357] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.443434] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.443522] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.443592] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2663bd-4c5a-4280-b2b0-ccd214332642',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.444378] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5546cce7-b8e5-406f-8abd-1541b01097c9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.444492] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.444552] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.444692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.444762] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5546cce7-b8e5-406f-8abd-1541b01097c9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.445452] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86e61356-708b-403e-ad42-c5f9a1dc7099 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.445563] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.445629] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.445774] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.445847] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86e61356-708b-403e-ad42-c5f9a1dc7099',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.446528] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2604d13b-747f-46b6-934c-17fb07504709 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.446642] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.446697] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.446841] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.446911] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2604d13b-747f-46b6-934c-17fb07504709',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.447594] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.447698] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.447759] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.448091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.448091] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6d0e84-a7cf-49a8-8525-71f68e22792c',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.448746] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-575bfa27-1492-4754-bbae-fa15d2d40215 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.448860] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.448908] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.449064] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.449137] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('575bfa27-1492-4754-bbae-fa15d2d40215',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.449847] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a105954-38cf-4ea3-9175-f0a7478feadd taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.449956] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.450038] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.450186] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.450270] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a105954-38cf-4ea3-9175-f0a7478feadd',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.450933] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.451054] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.451132] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.451263] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.451419] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef75b626-5ac5-4f1b-bccb-30d1c66c9174',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.453480] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.453591] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.453656] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.453805] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.453877] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.454563] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901fa1df-3975-439c-91f8-bc49d2f46c89 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.454664] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.454727] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.454872] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.454945] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901fa1df-3975-439c-91f8-bc49d2f46c89',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.455616] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9415ceef-7d41-4ca8-9473-e649728f53f9 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.455723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.455784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.455934] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.456016] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9415ceef-7d41-4ca8-9473-e649728f53f9',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.456678] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f149ebe9-de13-482c-885e-b787b9881cd4 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.456784] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.456843] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.457021] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.457065] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f149ebe9-de13-482c-885e-b787b9881cd4',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.590871] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de4557e9-9a44-4482-869f-e690653fe59e taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.591161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.591161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.591319] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.591422] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de4557e9-9a44-4482-869f-e690653fe59e',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.592229] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.592377] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.592443] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.592601] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.592659] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.670421] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.670691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.670691] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.670873] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.672653] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.672798] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.673547] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.673646] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.674367] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.674475] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.675161] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.675251] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.675887] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.675978] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.676732] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.676833] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.677507] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.677600] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.678293] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.678389] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.679771] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.679888] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.680615] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.680706] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.681359] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.681802] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.681895] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.682521] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.682914] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.683035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.683683] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.684095] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.684203] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.684778] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.685157] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.685258] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.685810] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.686218] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.686304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.686892] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.687279] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.687376] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.687932] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.688331] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.688442] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.689050] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.689423] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.689528] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.694921] env[65660]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1508.695387] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.695505] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901fa1df-3975-439c-91f8-bc49d2f46c89 is going to be deleted. [ 1508.696406] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.696649] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.713810] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.714029] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a105954-38cf-4ea3-9175-f0a7478feadd is going to be deleted. [ 1508.714933] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.715164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.735155] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.735315] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80 is going to be deleted. [ 1508.736169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.736393] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.756193] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.756343] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4 is going to be deleted. [ 1508.757230] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.757444] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.758856] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.758975] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.775911] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.776122] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.779932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.780110] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527845fc-1b66-4f17-85ee-b1fc80f19f8e is going to be deleted. [ 1508.781117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.781358] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.782813] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.782931] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.814199] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.814379] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acb2cb2-9e67-4059-8899-02421dd18f5c is going to be deleted. [ 1508.815245] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.815465] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.837678] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.837893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.847966] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.848370] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86e61356-708b-403e-ad42-c5f9a1dc7099 is going to be deleted. [ 1508.849100] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.849320] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.904291] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.904486] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2663bd-4c5a-4280-b2b0-ccd214332642 is going to be deleted. [ 1508.905392] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.905610] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.926023] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.926235] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.935850] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.936044] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6d0e84-a7cf-49a8-8525-71f68e22792c is going to be deleted. [ 1508.936855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.937091] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.942675] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.942879] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.957739] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.957967] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.994128] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.994398] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9415ceef-7d41-4ca8-9473-e649728f53f9 is going to be deleted. [ 1508.995252] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.995477] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.052884] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.053111] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.053997] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.054149] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 575bfa27-1492-4754-bbae-fa15d2d40215 is going to be deleted. [ 1509.054999] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.055229] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.176318] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.176546] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.186578] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.186773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.192386] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.192570] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.193467] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.193582] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cad2f7bd-5440-41f4-8c8a-0a54a291c118 is going to be deleted. [ 1509.194535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.194747] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.234847] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.235043] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2604d13b-747f-46b6-934c-17fb07504709 is going to be deleted. [ 1509.235953] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.236188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.244796] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.245034] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.295216] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.295441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.314829] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.315014] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5546cce7-b8e5-406f-8abd-1541b01097c9 is going to be deleted. [ 1509.315925] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.316181] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.354835] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.355083] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.375724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.375928] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de4557e9-9a44-4482-869f-e690653fe59e is going to be deleted. [ 1509.376788] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.377041] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.449723] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.449901] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21cb3633-17f4-47f6-b0c3-4263e0e499b6 is going to be deleted. [ 1509.450777] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.450990] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.460083] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.460273] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.488527] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.488527] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a is going to be deleted. [ 1509.489456] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.489661] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.524935] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.525169] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.534139] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.534300] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef75b626-5ac5-4f1b-bccb-30d1c66c9174 is going to be deleted. [ 1509.535223] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.535439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.562848] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.563072] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.564117] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.564310] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb72a34f-bda3-4818-a17c-194f6b875921 is going to be deleted. [ 1509.565110] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.565328] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.565414] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.565536] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901fa1df-3975-439c-91f8-bc49d2f46c89" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.565692] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.565849] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.565926] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.566048] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a105954-38cf-4ea3-9175-f0a7478feadd" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.566517] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.566675] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.566760] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.566870] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8fd8bd-4fbc-47ca-b5f6-05ad7dd42f80" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.566995] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.567151] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.567227] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.567335] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef7f05aa-9a85-4fe2-9db7-bab81d6f52e4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.567462] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.567597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.567670] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.567775] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527845fc-1b66-4f17-85ee-b1fc80f19f8e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.567932] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.568095] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.568188] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.568296] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acb2cb2-9e67-4059-8899-02421dd18f5c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.568419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.568556] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.568627] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.568724] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86e61356-708b-403e-ad42-c5f9a1dc7099" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.568852] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.568985] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.569069] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.569179] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2663bd-4c5a-4280-b2b0-ccd214332642" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.569304] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.569438] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.569509] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.569612] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6d0e84-a7cf-49a8-8525-71f68e22792c" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.569734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.569866] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.605813] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.606047] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.632799] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.633073] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f149ebe9-de13-482c-885e-b787b9881cd4 is going to be deleted. [ 1509.633853] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.634075] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.634164] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.634280] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9415ceef-7d41-4ca8-9473-e649728f53f9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.634439] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.634597] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.634673] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.634773] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-575bfa27-1492-4754-bbae-fa15d2d40215" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.635308] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.635478] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.635558] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.635681] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cad2f7bd-5440-41f4-8c8a-0a54a291c118" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.635812] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.635961] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.636049] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.636218] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2604d13b-747f-46b6-934c-17fb07504709" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.636303] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.636441] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.636526] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.636654] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5546cce7-b8e5-406f-8abd-1541b01097c9" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.636716] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.636893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.636893] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.637025] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de4557e9-9a44-4482-869f-e690653fe59e" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.637161] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.637247] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.637318] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.637429] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21cb3633-17f4-47f6-b0c3-4263e0e499b6" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.637559] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.637689] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.637758] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.637855] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf0d2d9-4754-405b-8269-b2b4cd4d5b0a" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.661510] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.661734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.661734] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.661909] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.662020] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.662143] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef75b626-5ac5-4f1b-bccb-30d1c66c9174" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.688042] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.688255] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.688302] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.688488] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.688576] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.688693] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb72a34f-bda3-4818-a17c-194f6b875921" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.713936] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.714152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.714152] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.714384] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.714500] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.714577] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f149ebe9-de13-482c-885e-b787b9881cd4" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.436843] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.437225] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1518.437965] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.437965] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.438619] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.438996] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.439599] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.439599] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.440472] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.440890] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.495876] env[65660]: INFO networking_nsxv3.common.synchronization [req-acb6175a-f2e7-487d-bdde-fdfe16a169e4 req-74764e8c-400d-4cd7-a64c-d43dce2f9df1 tempest-AttachVolumeShelveTestJSON-1237768587 tempest-AttachVolumeShelveTestJSON-1237768587-project-member] Enqueued Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1535.496486] env[65660]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 with Priority: HIGHEST for action security_group_members [ 1535.496822] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a85b3c-448d-4d7e-95a4-8b0306701612 taken with stack trace [, , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.496945] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.498051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.498051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.498051] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.498051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.498051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.498051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.498051] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.498051] env[65660]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a85b3c-448d-4d7e-95a4-8b0306701612',) {} {{(pid=65660) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.000032] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.000279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.000279] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.000474] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.020920] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.021170] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.021282] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.021352] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.021535] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.021616] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.021704] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 is going to be updated. [ 1536.049195] env[65660]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65660) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.049419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.049419] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.049590] env[65660]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.049730] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.057957] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: IN_PROGRESS for 2s [ 1538.069621] env[65660]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 in Status: SUCCESS [ 1538.070035] env[65660]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a85b3c-448d-4d7e-95a4-8b0306701612 deletion is rescheduled due to dependency. [ 1538.070035] env[65660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a85b3c-448d-4d7e-95a4-8b0306701612" {{(pid=65660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.497761] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.498173] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.499522] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.499522] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.500902] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.501387] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.502229] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.502597] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.503858] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.504266] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1565.504902] env[65660]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.505308] env[65660]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0